The bottom line is that there was definitely contact on the play, and that's a flag that an official is probably going to throw more often than not.
The Patriots made the flag pay off when they scored a touchdown two plays later on a one-yard touchdown run by James White. The score cut the Jaguars' lead to 14-10 at halftime.
More:
https://www.cbssports.com/nfl/news/look-twitter-irate-after-patriots-benefit-from-controversial-interference-call/
More:
https://www.cbssports.com/nfl/news/look-twitter-irate-after-patriots-benefit-from-controversial-interference-call/