A B C D E F G H I J L M N O P Q R S T U V W X

U

unlockAll() - Method in class xsmeral.semnet.crawler.URLManager

Unlocks all locked URLs.

unlockUrl(URLEntry) - Method in class xsmeral.semnet.crawler.URLManager

Unlocks the URL specified by given entry.

unlockUrls(Collection<URLEntry>) - Method in class xsmeral.semnet.crawler.URLManager

See unlockUrl

unmarshal(HierarchicalStreamReader, UnmarshallingContext) - Method in class xsmeral.semnet.xstream.ConfigurationConverter

unmarshal(HierarchicalStreamReader, UnmarshallingContext) - Method in class xsmeral.semnet.xstream.CrawlerConfigurationConverter

unmarshal(HierarchicalStreamReader, UnmarshallingContext) - Method in class xsmeral.semnet.xstream.EntityDescConverter

unmarshal(HierarchicalStreamReader, UnmarshallingContext) - Method in class xsmeral.semnet.xstream.HostDescConverter

unmarshal(HierarchicalStreamReader, UnmarshallingContext) - Method in class xsmeral.semnet.xstream.MappingConverter

UPDATE_DAY - Static variable in class xsmeral.semnet.crawler.model.URLEntry

Daily update frequency.

UPDATE_MONTH - Static variable in class xsmeral.semnet.crawler.model.URLEntry

Monthly (30 days) update frequency.

UPDATE_WEEK - Static variable in class xsmeral.semnet.crawler.model.URLEntry

Weekly update frequency.

UPDATE_YEAR - Static variable in class xsmeral.semnet.crawler.model.URLEntry

Yearly (365 days) update frequency.

updateEntry(URLEntry) - Method in class xsmeral.semnet.crawler.URLManager

Updates the given entry in DB.

uri(String) - Method in class xsmeral.semnet.scraper.AbstractScraper

Returns given URI normalized and resolved against current base URL if relative.

URLEntry - Class in xsmeral.semnet.crawler.model

The main entity used by URLManager.

URLEntry() - Constructor for class xsmeral.semnet.crawler.model.URLEntry

URLEntry(int, String, String, Date, int, int, boolean, String, boolean, short) - Constructor for class xsmeral.semnet.crawler.model.URLEntry

This constructor is meant to be called only by URLManager, which populates it with values from DB.

URLEntry(String, String, Date, int, int, boolean, String, boolean, short) - Constructor for class xsmeral.semnet.crawler.model.URLEntry

This constructor is used to create instances that are to be added to DB using URLManager.

URLManager - Class in xsmeral.semnet.crawler

URL Manager for HTMLCrawler.

URLManager(RDBLayer) - Constructor for class xsmeral.semnet.crawler.URLManager

Creates an instance for the specified DB layer.

URLManager.LimitClause - Interface in xsmeral.semnet.crawler

The LIMIT clause of SQL statement.

URLManager.OrderClause - Interface in xsmeral.semnet.crawler

The ORDER BY clause of SQL statement.

URLManager.Query - Interface in xsmeral.semnet.crawler

Complete SQL query.

URLManager.QueryBuilder - Interface in xsmeral.semnet.crawler

Builder of queries.

URLManager.QueryBuilderImpl - Class in xsmeral.semnet.crawler

Implementation of QueryBuilder for URL entries.

URLManager.QueryBuilderImpl() - Constructor for class xsmeral.semnet.crawler.URLManager.QueryBuilderImpl

URLManager.WhereClause - Interface in xsmeral.semnet.crawler

The WHERE clause of SQL statement.

URLUtil - Class in xsmeral.semnet.util

Provides methods for URL normalization and host equality comparison.

URLUtil() - Constructor for class xsmeral.semnet.util.URLUtil

Util - Class in xsmeral.semnet.util

Various utility methods.

Util() - Constructor for class xsmeral.semnet.util.Util