How to crawl through billions of web pages

Email LinkedIn
Tools

80legs Inc., a Houston-based startup, is marketing technology that allows companies to search and crunch millions of web pages within minutes--something that is increasingly necessary for companies that need to mine data, according to Computerworld.com.

CEO Shion Deysarkar told the magazine that the company is targeting customers such as market researchers looking to analyze the public's opinion on particular products or services, and lawyers searching for copyright infringement and piracy. The cost is low. Each search costs $2 per million pages searched plus 3-cents per CPU-hours used.

As companies grow their archives by terabytes, a search tool like this one is likely to be increasingly used to give the companies a leg up on the time it takes to find the right pages in response to a subpoena or e-Discovery order or any other demand. It will save a company dozens of hours sifting through any data center where information is stored

For more on this new search product:
- check out this Computerworld.com article

Related Articles:
IRS plans data mining to catch tax cheats
Making e-Discovery painless
Get up to speed on e-Discovery