Usse the extension->render-.grid to set up the grid on the canvas.
Have the grid layer abover the layer you will be drwing on.
Use the bucket tool being sure the layer that is active is not the grid layer.
Point the buket fill in each grid you want filled.
The bucket tool can be dragged accross multiple gird square and they will all be filled.