Grafted Mango Tree - Should I keep the flowers?

If you have a young Grafted Mango Tree it is probably flowering right now so this is timely advice on the question "Should I keep the flowers?"

Seedling mango trees can take 4-9 years before they even start flowering and when they do they are quite mature but your grafted mango tree can flower & fruit even in the first year like this mango tree in the video. So what happens if you don't interfere with your grafted mango tree and just let it flower and fruit? Are you doing the right thing?