Congressman wants to pump the brakes on allowing feds back to the office