asked the Duck.AI … Its answer was a bit overzealous. Also included blocking the competition
To allow DuckDuckGo to index your site while blocking other bots, you can use the .htaccess file to create rules that specifically allow DuckDuckGo’s crawler. DuckDuckGo uses the user-agent string DuckDuckBot. Here’s how you can set it up:
Access your .htaccess file: This file is usually located in the root directory of your website. You can access it via FTP or through your web hosting control panel.
Add the following code: Insert the following lines into your .htaccess file:
RewriteEngine On
# Allow DuckDuckGo
RewriteCond %{HTTP_USER_AGENT} ^DuckDuckBot [NC]
RewriteRule ^ - [L]
# Block all other bots
RewriteCond %{HTTP_USER_AGENT} ^.*(bot|crawl|slurp|spider|archive|wget|curl).*$ [NC]
RewriteRule ^ - [F,L]
We are fortunate that the WordPress (with its Download page links to GitHub), Sphinx and redirect to the MantisBT portions are still working. The SourceForge Mailing lists and, of course, this forum are hosted elsewhere.