Steve Bannon was released from custody after turning himself in on contempt of Congress charges Monday.

During his first court appearance, Bannon surrendered his passport, agreed to weekly check-ins and to seeking court approval for travel outside the U.S, according to CNN.

Bannon was indicted on Friday on charges of defying a subpoena to appear before the House committee investigating the Jan. 6 riots at the U.S. Capitol.

Bannon has refused to speak to the committee, despite being issued a subpoena earlier this year.

Prior to his court appearance, Bannon told reporters that "We're taking down the Biden regime." He also took part in a livestream where he told his followers to not take "their eye off the ball."

The House voted in October to hold Bannon in contempt of Congress. The charge was then sent to Attorney General Merrick Garland to determine whether to pursue criminal prosecution.

The Department of Justice says each charge carries a maximum of one year in jail.

CNBC reports that Bannon will have to appear in court again on Thursday.