How to know if an incoming phone number is a scam number?

I see many phone numbers calling without any missed calls, which is very suspicious and likely a scam phone number.