How to set up a Web Repository and Crawl it for Indexing
The scenario assumes that you want to make the Internet pages of a news provider accessible through the portal. The Web server of the news provider is to be checked twice a day for new documents. The documents can be indexed after the crawler has found them on the Web site. The documents are then available to portal users when they carry out a search. If you are using taxonomies, you can also place these documents into categories. Portal users then access the documents through a taxonomy.