# Allowlist Crawler Media Sosial & Search Engines User-agent: facebookexternalhit Allow: / User-agent: Facebot Allow: / User-agent: meta-externalagent Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: Twitterbot Allow: / User-agent: LinkedInBot Allow: / User-agent: WhatsApp Allow: / User-agent: TelegramBot Allow: / User-agent: Googlebot Allow: / User-agent: * Allow: /