Unlist your number from TrueCaller

If you don't want your number to be searchable in the Truecaller app, 
then enter your phone number in truecaller website including the country code and press 'Unlist'. (i.e. +4690512214).

https://www.truecaller.com/unlisting