To add a border to a picture, you must first select the picture.
Click the format picture button
This will display the format picture dialog box:
Colors and Lines
If you want to draw a border around all the sides of the shape you can just select Line Style button on the Picture toolbar and choose from a suitable line style