The most common Biblical use of the word ‘perfect’ means something quite different than how it is generally understood (either philosophically or in the pop-culture way you describe). The Greek words often translated ‘perfect’ (teleioo; teleios) could just as well be translated “finished”, “completed”, “matured”, or “brought into maturity”. The word ‘perfect’ in the philosophical sense means something more like “than which nothing greater can be conceived”, as Anselm put it. The way you put it works, too.

I think the preacher guy you quote is profoundly wrong either way we understand his use of the word.