Fears for specialist lenders over new rules