We are always looking for ways to make using Search easier. With that in mind we are now offering a beta site crawler to help index your website faster. At the moment we will need to set this up on our end and schedule regular indexing of your site.
What does the Crawler provide?
Using the Searcheo Crawler means that you don’t have to spend any time populating your search index. Once your crawler index is setup it will be automatically updated so new content will be added to your search engine.
Searcheo will setup and manage your crawler for free and help you to extract the site content from your HTML layout.
If for any reason you need to whitelist user agents you will see crawling traffic using the “Searcheo Crawler” user agent string.
Reach out and let us know about your new Search project today.