Niche Spider - what is it? Simple - it's a spider, a piece of software which grabs specific webpage data. It can grab data from tens of thousands of sites, and then present the data collected in nice, neat pages WITHOUT THE NEED OF ANY DATABASE. Yes NO database programming required!
When visiting a website, Niche Spider also leaves it's calling card in the site's visitor logs (the 'Referer' and 'User-Agent', which you can set), just like Googlebot or any other spider or web crawler. That, in itself, is a great way to announce yourself to the world, and to generate some curiosity/traffic at the same time. However, Niche Spider is NOT Googlebot, or Yahoo's Slurp, or MSN's MSNBot. Google, Yahoo and MSN have access to computers, servers and databases us lesser mortals can only dream about. And the spiders they use crawl the web, looking for and following links to pages, which are then added to their respective databases. Such is their power they can traverse the entire web in a month or two, or less, adding and updating billions of pages in the process. Niche Spider does NOT crawl the web, but targets a small piece of the web instead (a niche area). You decide what that niche is.
See also: spider, crawler, bot, search, search engine, adsense, google
|
Software Crown
