To avoid undesirable content in the search indexes, webmasters can instruct spiders not to crawl certain files or directories through the standard robots.txt file in the root directory of the domain. Additionally, a page can be explicitly excluded from a search engine's database by using a meta tag specific to robots (usually ). When a search engine visits a site, the robots.txt located in the root directory is the first file crawled. The robots.txt file is then parsed and will instruct the robot as to which pages are not to be crawled. As a search engine crawler may keep a cached copy of this file, it may on occasion crawl pages a webmaster does not wish crawled. Pages typically prevented from being crawled include login specific pages such as shopping carts and user-specific content such as search results from internal searches. In March 2007, Google warned webmasters that they should prevent indexing of internal search results because those pages are considered search spam.[45]
Having a different description meta tag for each page helps both users and Google, especially in searches where users may bring up multiple pages on your domain (for example, searches using the site: operator). If your site has thousands or even millions of pages, hand-crafting description meta tags probably isn't feasible. In this case, you could automatically generate description meta tags based on each page's content.
Imagine that you've created the definitive Web site on a subject -- we'll use skydiving as an example. Your site is so new that it's not even listed on any SERPs yet, so your first step is to submit your site to search engines like Google and Yahoo. The Web pages on your skydiving site include useful information, exciting photographs and helpful links guiding visitors to other resources. Even with the best information about skydiving on the Web, your site may not crack the top page of results on major search engines. When people search for the term "skydiving," they could end up going to inferior Web sites because yours isn't in the top results.
The pre-production stageExtended ArticleEverything You Need to Know About Video Pre-ProductionPre-production is the first and one of the most important stages of the video production process. If you’re thinking of hiring a video production… Read More essentially covers all your video planning. It’s the first and most important stage of the production process because it sets your entire video in motion. At this stage, you’ll want to clearly define the content of your video, get feedback from all relevant team members, and start booking and scheduling your shoot. If you’re hiring a production team or agency, you’ll want to do all your company vetting, creative calls, and approvals here.
Collaborative Environment: A collaborative environment can be set up between the organization, the technology service provider, and the digital agencies to optimize effort, resource sharing, reusability and communications.[36] Additionally, organizations are inviting their customers to help them better understand how to service them. This source of data is called User Generated Content. Much of this is acquired via company websites where the organization invites people to share ideas that are then evaluated by other users of the site. The most popular ideas are evaluated and implemented in some form. Using this method of acquiring data and developing new products can foster the organizations relationship with their customer as well as spawn ideas that would otherwise be overlooked. UGC is low-cost advertising as it is directly from the consumers and can save advertising costs for the organisation.

2. Domain authority and page authority. Next, you should learn about domain authority and page authority, and how they predict your site’s search rankings. Here’s the basic idea; your site’s domain authority is a proprietary score, provided by Moz, of how “trustworthy” your domain is. It’s calculated based on the quantity and quality of inbound links to your website. The higher it is, the higher all your pages across your domain are likely to rank in organic search results. Page authority is very similar, but page-specific, and you can use it to engineer a link architecture that strategically favors some of your pages over others. Authority depends on the authority and volume of inbound links.
By building enormous amounts of value, Facebook and Google both became tremendously successful. They didn't focus on revenues at the outset. They focused on value. And every single blog and business must do the same. While this might run contrary to someone who's short on cash and hoping that internet marketing is going to bring them a windfall overnight, it doesn't quite work that way.
There are plenty of tactics you can use to ensure your videos get found easier in search engines. The first thing you should do to derive the maximum SEO value from your video (before you upload your video to any sharing sites) is to host it on your own domain. It’s also important to enable embedding on your video as this will help you increase the likelihood of receiving inbound marketing links. Oh and don’t forget to avail of video sitemaps – in this nifty document Google explains how to create a video sitemap with ease.