Automated content scraping and importing plugin for WordPress
WP Content Crawler - Get content from almost any site, automatically!
WP Content Crawler automatically collects and imports content from external websites into WordPress posts, with configurable scraping rules, scheduling, translation support, and content transformation options.
Included with purchase:
- 100% GPL Licensed
- Lifetime Updates
- Technical Support
- Instant Download
Download for Free
Get this product and unlock 4,500+ premium plugins & themes for just $15.00/month.
What is WP Content Crawler - Get content from almost any site, automatically!?
WP Content Crawler is a premium WordPress plugin that automates the process of collecting content from external websites and importing it into WordPress posts or custom post types. This plugin is particularly useful for content marketers and bloggers who want to streamline their content curation process. Key features include automated crawling that allows users to schedule content collection at configurable intervals, precise content targeting using CSS selectors, and image handling capabilities that enable downloading and local hosting of images. This plugin is compatible with various WordPress themes and setups, ensuring flexibility in its implementation. Available at PluginTheme.net with GPL license, instant download, and lifetime updates.
Key Features
CSS Selector Extraction
Target specific content elements using CSS selectors with visual testing tool for validation
Scheduled Crawling
Configure automatic content collection at hourly, daily, or custom intervals
Image Import
Download and locally host images from source sites with proper file management
Content Templates
Format imported content using templates with dynamic data placeholders
Translation Support
Integrate with translation services to auto-translate imported content into target languages
Who is this for?
Pros
- Automated crawling: Schedule content collection at configurable intervals
- CSS selectors: Precise content targeting with visual selector testing
- Image handling: Download and locally host images from source sites
- Content transformation: Find-replace and template formatting for imported content
- Custom field mapping: Map scraped data to custom fields and taxonomies
Cons
- •Content scraping must respect source site terms and copyright laws
- •Complex site structures may require advanced CSS selector knowledge
- •Scheduled crawling consumes server resources during execution
Product Description
WP Content Crawler automates content collection from external websites and imports it into WordPress posts or custom post types. The plugin provides configurable scraping rules, scheduling, and content transformation for automated publishing workflows.
Scraping Features
- CSS selector-based content extraction
- Multiple page and pagination support
- Image downloading and local hosting
- Custom field mapping for structured data
Automation Tools
- Scheduled crawling at configurable intervals
- Content translation integration
- Find-and-replace text transformation
- Template-based content formatting
The plugin provides a visual testing tool for validating CSS selectors before running full crawls. Post scheduling distributes imported content over time for natural publishing patterns. Available at PluginTheme.net with GPL licensing and instant download.
Our Verdict
PluginTheme Team
Expert Reviewer
WP Content Crawler provides capable web scraping for WordPress with reliable CSS selector targeting. The visual testing tool helps build accurate extraction rules, and the scheduling system maintains consistent content collection.
