Patriots fans might have another reason to be worried that Tom Brady is planning to leave New England this offseason.  On Tuesday, the legendary quarterback stepped down as the Honorary Co-Chair of the Best Buddies Challenge: Hyannis Port.

It’s a position Brady had served in for the past 16 years.  He passed the leadership baton to current Co-Chairs, Celebrity Chef Guy Fieri, Congressman Joseph P. Kennedy, III., and welcomed new Co-Chairs Julian Edelman and Jayson Tatum.

RELATED: Tom Brady is “On To Cincinnati” After Home Loss to Chiefs

Brady said he plans to continue supporting the organization as a Global Ambassador.

Flip the Page to see Brady’s comments on stepping down as the Co-Chair of the Best Buddies Challenge: