Scrapy is an extremely efficient framework to write web spiders.¬† With just 30 lines of codes, you can write a crawler that can go through each link in your website and report each link , with HTTP status and the link from where it is linked. I use this spider to detect broken links on …

Continue reading Crawl your site and find all broken links using Scrapy

I use nextend Smart Slider 2 for my joomla website. Its a great component that lets you create the responsive sliders, with CSS animation. However I noticed exceptionally large numbers of files , close to 77K . The total number of files on this joomla installation was 96K – 80% was Nextend.¬† Deleting the cache …

Continue reading /media/nextend/cache – 77,000 files