This is more than likely due to limescale build up.

Limescale in some parts of the country can manifest itself as a red / brown deposit due to minerals naturally occurring in the water or on rare occasions sediment from the water supply pipes.

Descaling your kettle should remove the deposit.

To reduce limescale build up use filtered water.