I can't say enough how playing this game without the mini map constantly distracting me, has changed the game completely. I have had Witcher 3 on PS4 since it first was released. I actually downloaded it (which I never do) as I knew it would be good. However, no matter what, I could never play it consistently. I don't know if it was other games (big Metal Gear fan) or if it was just life.
One of the reasons is that I could never really enjoy the world that CD Project Red made because I would constantly just follow the mini-map and not take in the sites. So, I started thinking... why don't I treat this game like Dark Souls? So I removed the mini map, cranked the game to it's hardest difficulty and decided to explore the world and just see what happens.
Now I can't stop playing the game, after years of not picking it up. Some people are going to say " the world is too big and I will get lost" or "I hate pausing the game to constantly check the map." All reasons are valid. However, once you look at the game in the prism of this is "Dark Souls" but with a story and just explore the world, the enjoyment is so much more impactful than before.
As far as getting lost, once you actually look at the world as it is and get used to the idea of finding things, you will begin to memorize areas and you can travel without even using the map. I've gotten so familiar with the world that I can travel on horseback from point to point without even looking at the map, that also includes the cities and villages. This, in my opinion, is much more satisfying than just following some UI that does all the thinking for you.
So try this out guys, just explore the world and see how much more enjoyable it can be. It actually turns this already great game into a completely new game experience. Also, there is nothing wrong with being lost, just explore and see what enemies you encounter and what loot you can find. The randomness and unpredictability of that can be enjoyable in itself anyways.
Treat the game like Dark Souls (remove mini-map, and mission prompts) and you won't regret it.