Newnex
FeedProducts & ServicesNetworkNews and ViewsChat Groups
Platform
EventsAbout
Member LoginGet Access

Newnex · Bot policy

How Newnex fetches link previews

When members of Newnexshare a URL in a post, we fetch the page's public Open Graph metadata so the Newnex feed can show a small preview card. This page documents what we do, why, and how to control it.

User-Agent

Our link-preview fetcher identifies itself with the User-Agent string Newnex-LinkPreview/1.0 (+https://www.newnex.io/about/bot). Both Newnex and Startup Europe India Network deployments use this string.

What we read

  • og:title, og:description, and og:image tags from the HTML head.
  • twitter:card tags as a fallback when Open Graph tags are absent.
  • The page title and meta description as a final fallback.

What we do not do

  • We do not scrape the body of articles, paywalled content, or any content beyond the metadata tags listed above.
  • We do not bypass robots.txt, X-Robots-Tag headers, or paywall authentication.
  • We do not store your images on our infrastructure. Image URLs are referenced directly so the image is fetched from your own CDN by the viewer's browser.
  • We do not republish article content. Source attribution (your domain) is shown prominently next to every preview card.

How to opt out

Newnex respects robots.txt and X-Robots-Tag response headers. If you do not want our fetcher to retrieve link previews from your site, you can:

  • Add a Disallow rule for our User-Agent in your /robots.txt:
    User-agent: Newnex-LinkPreview
    Disallow: /
  • Set X-Robots-Tag: noindex, noimageindex on the responses you don't want included in previews.
  • Omit Open Graph and Twitter Card tags from the pages you don't want previewed; we will fall back to the bare URL.

Changes take effect on the next preview fetch. Existing cached previews refresh within 24 hours.

Takedown / DMCA

If you believe content shared on Newnex infringes your copyright, or you want a specific URL removed from our preview cache, contact us at team1@startors.com. Include the URL of the Newnex post and the URL of the content in question. We respond to legitimate takedown requests promptly and honor the DMCA safe-harbor process.

← Back to about Newnex