The following are the ways:

At a site or directory level, use .htaccess to add password protection.
At a site or directory level, make use of a robots.txt file.
At a page level, use the noindextag.
At a link level, use a nofollow attribute.
If the content has already been crawled, use the Google url removal tool as a last resort