Quantcast
Channel: WordPress.org Forums » [All-In-One Security (AIOS) – Security and Firewall] Unresolved Topics
Viewing all articles
Browse latest Browse all 248

How to add a user agent to allowlist in robots.txt

$
0
0

Replies: 1

I am trying to setup a facebook login but my site is giving a 403 error for facebookexternalhit agent. How to add it to allowlist using AIOS? Here is the error:

Response Code: 403

Response Code Reason: This response code could be due to a robots.txt block. Please allowlist facebookexternalhit on your sites robots.txt config to utilize Facebook scraping


Viewing all articles
Browse latest Browse all 248

Trending Articles