Package xsmeral.semnet.crawler

Core classes of the crawler - the crawler/processor itself, host manager, URL manager, DB layer

See:
          Description

Interface Summary
HostMapper HostMapper is responsible for mapping hosts to IDs.
URLManager.LimitClause The LIMIT clause of SQL statement.
URLManager.OrderClause The ORDER BY clause of SQL statement.
URLManager.Query Complete SQL query.
URLManager.QueryBuilder Builder of queries.
URLManager.WhereClause The WHERE clause of SQL statement.
 

Class Summary
HostManager Host manager for HTMLCrawler.
HostManager.Mapper Mapper is responsible for mapping hosts to IDs.
HTMLCrawler A web crawler of HTML pages.
RDBLayer Relational DB Layer for Crawler.
URLManager URL Manager for HTMLCrawler.
 

Exception Summary
ConfigurationException Indicates a problem with user configuration.
 

Package xsmeral.semnet.crawler Description

Core classes of the crawler - the crawler/processor itself, host manager, URL manager, DB layer