most likely, you are in an area highly populated with wireless networks, and by default they all run on channel 6... so you're probably picking up interference... i had the same issue at my residence... i got a linksys router and reprogrammed it with ddwrt which lets me boost the antenna output... paired with 7db high gain antennas, i no longer have a problem...
While your right about changing the wireless channel, you must also keep in mind that certain wireless frequencies will affect overall coverage area as well... In the OP's case, this may help... However, if he is in a populated area as I am, then many channels will already have traffic and he may need to look furthur to alleviate the problem...
Toronto has established itself as the Jersey Shore for Punjabis.
i have heard great things about linksys mimo routers...also, comcast cable [internet] sucks...