Prince Andrew, who was to attend the annual racing event this week along with other members during the carriage procession, did not attend the event.
A source told the Times that in a decision made "without fuss" he chose to stay away, following controversy stemming from his desire to attend Monday's Order of the Garter ceremony at Windsor Castle.
Prince Andrew is said to have missed the game after the Prince of Wales and the Duke of Cambridge spoke out against his participation in the event. It appears that the decision was made at the last minute.
According to Finding Freedom writer Omid Scobie, she was left "crushed and confused" after Duke was banned from participating.
Writing in his column for Yahoo News, Omid, known for his biography about the Duke and Duchess of Sussex, the source said Andrew was "crushed ... [and] a bit confused".
The Duke of York reportedly admitted that he was allowed to attend the event along with other working members of the royal family.
Omid said the monarchy's "reluctance to completely remove Prince Andrew from all aspects of royal life" is "damaging" and "reflects greatly on the family".
He added: "The reluctance was evident ... when Andrew was allowed to walk the Queen in front of the world's media for Prince Philip's televised memorial service, and when he was given the go-ahead to attend some Platinum Jubilee events was."
"Every opportunity given to Prince Andrew to reestablish his image is one step closer to further loss and shame for the institution of the monarchy. This is a disaster waiting to happen."