U.S. Sen. Pat Roberts has announced he’ll vote against a bipartisan budget deal, but the Kansas Republican’s primary opponent says Roberts should have spoken up earlier.

Roberts said Wednesday that he doesn’t think the deal tackles major fiscal problems and represents only more taxing and spending. The deal was crafted by Republican House Budget Committee Chairman Paul Ryan of Wisconsin and Democratic Senate Budget Committee Chairwoman Patty Murray of Washington.

Roberts’s comments came shortly after GOP primary opponent Milton Wolf called on the senator to vote against the package. Wolf began criticizing a possible deal last week, when it was still being negotiated.

Wolf said Roberts hasn’t been vocal enough.

But Roberts’ executive campaign manager Leroy Towns said Kansans expect their senator to study legislation before criticizing it.