Indexing the Web—It’s Not Just Google’s Business

by Lyle Mullican

22 Reader Comments

Back to the Article
  1. that’s a really interesting article. I remember the days where it took about 30 minutes to index a page :)

    Mike Hersh
    imblogging.com

    Copy & paste the code below to embed this comment.
  2. Sounds like building a good website is like building a good building
    If the foundations are stable, it will last for a good while.

    Copy & paste the code below to embed this comment.
  3. Great article. You have really illustrated the key things that are needed for indexing the web. In fact, these are the most important but oft-forgotten tweaks!

    Thanks for sharing!

    Copy & paste the code below to embed this comment.
  4. “Think of it this way—it’s like looking up the word “poultry” in the back of the cookbook instead of flipping through each page and putting a marker on all the chicken dishes.”

    That summarizes the entire article in a nutshell.  Good advice on how to keep databases running smoothly and efficiently, thanks.

    Copy & paste the code below to embed this comment.
  5. It was interesting that you mentioned frameworks.  I use Django, I just checked the MySQL tables it creates, and it seems to index the foreign keys.

    But it’s a lesson learned for me, as I’ve never really looked at database optimisation before.  Time to start I feel!

    Thanks

    Copy & paste the code below to embed this comment.
  6. It is not only me most of the webmasters and SEO experts would be thinking that indexing is Google’s job. But now I got what to do to make the search engines index the pages of the websites.

    Copy & paste the code below to embed this comment.
  7. Reading the acticle I hate to say that Google dictates our behavior forcing us to pay 24/7 attention if you do website promotion

    Copy & paste the code below to embed this comment.
  8. Database optimization is an often-overlooked aspect of web development. Many of the projects I’ve worked on pay absolutely no attention to it – to the extent that the only index on a given table is a primary key. Optimizations can have vast impacts on server performance; I recently built an ajax-based real time chat app that saw performance gains of about 60 times with some indexing and SELECT query optimizations. The “SELECTUSING” syntax is a godsend for hinting the database to use an indexed column in a multi-column select condition.

    Copy & paste the code below to embed this comment.
  9. Here is the translation of the article: http://interpretor.ru/sql_indexing

    Thanks for the great article!

    Copy & paste the code below to embed this comment.
  10. Interesting article! And this commentfield is really well designed :)

    Copy & paste the code below to embed this comment.
  11. Great reading, very good article. Thank you

    Copy & paste the code below to embed this comment.
  12. Helped me realize some very good points.

    Copy & paste the code below to embed this comment.