Since you are only intolerant rather than allergic I'd say you're safe to eat them, I'm also wheat and gluten intolerant but can and do eat small amounts of wheat/gluten.It's kind of important to me as I'm gluten and wheat intolerant.
My problem is kind of self diagnosed , the doctor was next to useless ,and I passed the blood test for being a coeliac but it only takes a minute amount to start my problems ,Since you are only intolerant rather than allergic I'd say you're safe to eat them, I'm also wheat and gluten intolerant but can and do eat small amounts of wheat/gluten.
I've not done the chemist test only blood test, I will look in to it.You state you passed the blood test... is that one of those allergy tests you can do at your local chemist ?
I noticed I was having bad guts after eating various foods and suspected I was intolerant so I did the food intolerance test at my local chemist which confirmed my suspicions. If you haven't done such a test it's worth doing in case it highlights anything else that upsets you.