I finally decided I needed to sort out the font size in safari mobile, after a little tinkering it turns out you can just set the -webkit-text-size-adjust to "none" and that stops the browser from resizing the text.
body {
-webkit-text-size-adjust:none;
}