They did that, but it was a sham debate, and the occupation of the Capitol destroyed that effort completely. Though Pence had already promised that he would count and accept the electors submitted. But the debates focused more on the occupation than they did the objection. I should say that the House had debates on both objections of state electors. The Senate only did 1 debate on, I believe it was Pennsylvania.
The debates focused more on the occupation than they did the objection.