Silly? question re taking BBT

I'm about to start charting before TTC with IUI (donor sperm).  I have a question re taking BBT and it just seems so silly, but nothing I've read has addressed it and I'm left wondering:

Sometimes I get too hot in bed, kick the covers off, and then wake up a little too cold.  Wouldn't that affect the temp reading?

Any advice?

Thanks!