What is LiteSpeed crawler ?
The LiteSpeed Crawler is a caching plugin designed to periodically refresh your websites' cache. It ensures that visitors do not encounter any uncached pages, providing a seamless browsing experience.
Procedure to enable LiteSpeed crawler in webuzo
Using below Crawler Snippet You can Enable/Disable Crawler at Server & VHost level
Enabling Crawler Snippet
<IfModule Litespeed>
CacheEngine on crawler
</IfModule>Limiting Crawler Snippet
<IfModule LiteSpeed>
CacheEngine on crawler
SetEnv CRAWLER_USLEEP 1000
SetEnv CRAWLER_LOAD_LIMIT 5.2
</IfModule>Disabling Crawler Snippet
<IfModule LiteSpeed>
CacheEngine -crawler
</IfModule>Server-Level
Add above Crawler Snippet at /usr/local/lsws/conf.d/lsws_crawler.conf
Note: You need to create lsws_crawler.conf if not exists.
Per Domain-Level
Add above Crawler Snippet at
/var/webuzo-data/lsws/custom/domains/Domain_Name.conf
Note: If these directories do not exist, create them.
Per User-Level
Add above Crawler Snippet at
/var/webuzo-data/lsws/custom/users/User_Name.conf
Note: If these directories do not exist, create them.
After adding crawler Snippet run the following command:
webuzo --rebuild_vhost