Lord Levy said it was "inconceivable" that Mr Brown was not aware that the party was receiving substantial sums in loans which were not declared to the Electoral Commission.
Lord Levy insisted that Mr Brown's central role in the 2005 general election campaign meant he must have known how the campaign was being funded.
He said: "The returns to the Electoral Commission are showing quite clearly where all the donations are coming from.