Software > Internet > Webmaster Tools > Content Crawler

Content Crawler

The contentCrawler enables the extraction of structured data on the Internet

Version:  1.0


Our company is an expert in crawling websites and documents using artificial intelligence and machine learning techniques. For more than ten years mindUp has been using crawlers to collect structured data on the Internet (information harvesting, web farming). Fields of application are content-based advertising (e.g. for eBay Relevance Ads, billiger. de content Ads and smartshopping context ad), behavioral targeting (auto-categorization of websites to build up user profiles of surfers and the subsequent customer group-related advertising), the structured extraction of product data, tenders or betting odds, the monitoring of forum buzz for the purpose of brand monitoring, the matching of existing addresses against the addresses on company imprint pages, the finding of new partners on the WWW whose topics match one's own products (affiliate scouting). Another use case is the abuse detection of advertising and affiliate links (positioning of postview campaigns, cookie dropping, click fraud).


Features an adaptive web crawler or spider system that can automatically retrieve and process web content.

The web crawler system has the following features:

  • Highly scalable for any size application
  • Many millions of web pages daily
  • Any extraction task possible (Extraction Agent)
  • Adaptive scanning (domain scanning)
  • Webfarming

It masters the recognition of web content to perfection. Be it the extraction of product information (real estate ads, car ads, classifieds, personals) to generate market data or price comparisons, or the finding and checking of address data. mindUp's crawler technology paired with content extraction allows many areas of application.

Target groups:

  • Competitive Intelligence
  • Misuse Detection
  • Intellectual Property - Detection of brand abuse on the Internet
  • Brand Monitoring
  • Data extraction
  • Data verification
  • Link analysis
  • Autocategorization of websites
  • Finding new affiliate partners
  • Trademark monitoring
  • Verification of addresses
  • Collecting products, prices, offers, tenders, ...
Send message
Links & Downloads:
Software exposé
request URL

Functions (excerpt) of Content Crawler:

Address database
Address import
Address synchronization and matching
Address management
Database search
Data sources
social media channels
Search strategies


on request

Get to know the software better! Request a video appointment for a personal presentation!

Technical specifications:

SaaS, Cloud:
Multi-user (network-compatible):
Manufacturer based in:
System requirements:
Compatible operating systems (runs with):
Win 11
Win 10
Win 8
Win 7
Win Server
Mainframe based
Unix based
Linux based
Mac OS
Mobile OSs (supports):
data storage medium:
Flash memory

Content Crawler is listed in the following categories