# Version 22.01.2025 # https://group.dhl.com/ # Settings for Norconex Crawler and the Cloud Native Crawler (for GCS) User-agent: dhl-cloud-crawler User-agent: dhl-norconex-crawler Allow: / Allow: /content/dam/deutschepostdhl/en/media-center/ Allow: /content/dam/deutschepostdhl/de/media-center/ Disallow: /content/dam/deutschepostdhl/ User-agent: * Allow: / Disallow: /sureroute-test-object.html