@fify-- I think you should follow what your doctor has recommended. My doxycycline treatment was short so my doctor told me to avoid dairy, as well as antacids.
Most people don't realize that it's not really dairy that interacts with doxycycline, but the calcium in it. So everything that's high in calcium and iron needs to be avoided while on this antibiotic.
Some doctors are not very strict when it comes to this combination but I think that everyone's system works a little differently. Milk takes a very long time to digest. So taking doxycycline one to two hours after drinking milk might still cause an interaction. So double check with your doctor about your current medication timing.