Firebug will be a massive help to you, especially if this is your first experience with WP.
All changes that are not in the admin will be in the theme folder, either in the "css" or "images" folders.
The logo image is located in the "images" folder inside the theme directory. Just overwrite that image with your replacement and don't forget to clear your browser cache.