I found some small framed chalk boards at the craft store. I also bought a chalk marker to write the numbers. It looks just like chalk.
I made myself an outline with a white pencil.
Isn't this chalk pen the coolest?
I am not sure if this is where they will stay. I might put them diagonal above the mail box, but you get the idea.