Rear exhaust manifold bolt wont fit - easy fix idea?

I replaced my head gasket 200 miles ago and noticed then it didn't have a rear (against fire wall) bolt in the exhaust manifold. When I went to put it back on the bolt holes would not line up to allow me to use the correct bolts. I am now tired of smelling and smelling like exhaust fumes all the time and want to seal it up. Does any one have a suggestion to seal this up, preferably without removing the manifold? The bolt is off maybe 1/4 of hole size. I searched and couldn't find solutions. Thanks