Tim is on target here. 5GHz is faster, but it is definitely range limited and very susceptible to interference. 2.4GHz has a far greater range, and less likely to drop out, but it comes at a cost of slower performance. Look at your settings to see if it has automatic switching on your card, or if you can select which setting (5GHz or 2.4GHz) is your default. Consider relocating the WiFi antenna to a higher position in the house, a different position in the room, or more central to the two of you. You may see a huge improvement.
For me, my path between the router and over half of the rest of the house has my washer and dryer (and my HVAC ventilation system) in the way. The router has to be at least 5' off the ground to get any signal to those other rooms at 5GHz.