A.J. Brown struggled to make an impact in his first appearance back for the New England Patriots after spending four games sidelined with an ankle injury.