In a candid interview with Oprah Winfrey on Sunday, Prince Harry revealed that following discussions of his exit from the royal family , his father, Prince Charles , stopped taking his calls.

Harry said that his father had asked him to put his and Meghan Markles plans to leave in writing, which he did. But the future king was still unhappy with Harrys decision.

I took matters into my own hands, Harry told Winfrey. It was like, I need to do this for my family. This is not a surprise to anybody. Its really sad that its got to this point, but Ive got to do something for my own mental health, my wifes and for Archies as well, because I could see where this was headed.

Later in the interview, Harry admitted he felt let down by his father, who went through a similar situation with Harry and Prince William s mother, Princess Diana of Wales .

He knows what pain feels like, and Archies his grandson, Harry said. But at the same time, of course I will always love him. But theres a lot of hurt thats happened and I will continue to make it one of my priorities to try and heal that relationship.

For the past few years, reports have also surfaced of fraternal fissure between Harry and William, who now live in different countries after Harry and Meghan officially stepped back from the royal family for a life of service in Los Angeles. William reportedly felt that Harry was abandoning his sense of duty and birthright, especially considering Queen Elizabeth s age and their fathers potential accession to the throne.

But on Sunday, now 36, Harry shot down rumors that he and William were still feuding, telling Winfrey, I love William to bits. Hes my brother, weve been through hell together ... but we were on different paths.

The relationship is space, at the moment. And, you know, time heals all things, hopefully, he added.