Conditional fees set to go ahead despite judge's fears