But he will charge a certain fee halfway and can't return it all.

Matchmaking agencies belong to service units. Whether the fee can be refunded depends on the specific agreement of the service and fee in the service contract between the two parties. If the matchmaking agency does not provide relevant services, the service fee can be refunded in principle.