How to stick house numbers up on stone

[MRubenzahl]

I have a big stone out front and I want to mount some plastic numbers on it. I temporarily stuck them up with double-stick foam tape and to my surprise, they stayed there for months, but once freezing temperatures arrived, the adhesive said, "nope, I don't do that." I got some Gorilla Double-Stick that said indoor, outdoor, stone, yadda yadda. But it's a thin tape and won't stick to the not-really-flat stone face.

Ideas? Looking for a double-stick tape solution and want to avoid drilling holes in rock.

[handyandy]

What about something like Gorilla Glue or Concrete Glue?