Do not touch anything around frames not containing a text-box

Avoid dealing with the hierarchy of frames that we wouldn't really
process anyway, to avoid any possible behavioral changes.