The "Edit" link only shows if you are logged in.
"Uncategorized" means that the post/page hasn't been added to any categories yet.
If you really want to hide that section of the page just add the following code to the bottom of style.css:
div.entry-utility {
display:none;
}
That will make the whole section disappear.