@burcidi-- I know what you're going through, I had the same problem several years ago. Mold fungi can be very difficult to get rid of, especially when the temperature and moisture levels are perfect for it.
If possible, try to turn off any heat in the basement and don't use it for a while. Aspergillus also likes to grow in the foam in mattresses and couches. So you might have to get your furniture, beds, carpets out of the basement to treat it and kill the mold.
At one point I was even suspecting my plants. I heard that aspergillus can grow in the soil of house plants, especially if it's in a warm spot.
I think you should make a checklist of everything in the house or basement that aspergillus might be growing in and take some action to kill it. Taking away the heat and moisture should be the first step.