This video shows a forge being lined without the use of refractory over the thermal blanket.  

I used forges lined this way (as have many others) for years before I learned about refractory coverings.

I currently recommend you put at least one coat of refractory (first coat of slurry shown in the Super C videos) on thermal blanket.