Layers are a way to easily modify or change your graphic design. They make adding special effects to specific parts of the design very easy to achieve. Also you can delete a layer and not affect the rest of your design.
Gimp Tutorial: Reflection Effect with Text
You can also do this with a picture not just text. To make life simpler i would advise with the black background to start off with cos its a lot easier to manage.