AI Policy & AEO

Last updated: 4 September 2026

This page sets out how GoCoreVantage Pte Ltd handles automated AI crawlers on gocorevantage.com. It explains which crawlers we block, which we allow, and why the distinction matters for Answer Engine Optimisation (AEO). Our crawler directives are published in robots.txt.

What we block and why

We disallow the following AI training crawlers across the whole site:

These crawlers collect content as training material for large language models. We do not authorise our content to be used as model training material without consent or compensation. Blocking them does not affect how our pages rank in search, and it does not stop AI assistants from citing us — that is handled by a different set of crawlers.

What we don't block

We deliberately allow the crawlers that let AI answer engines read, quote, and link to our pages in real time:

The distinction is the whole point. AEO is about being cited in AI answers — appearing as a named, linked source when someone asks an assistant a question in our field. It is not about being absorbed into a model's training data, where the content is repeated without attribution and sends no one back to us. Blocking training crawlers while allowing citation crawlers keeps the visibility and drops the extraction.

What this means for our SEO + AEO service

We apply the same policy to client sites we build and optimise. The AEO work we sell on our Services page is built on this split: structure the content so answer engines can quote it accurately and attribute it correctly, while keeping control over what gets used as training material. We treat that control as part of the deliverable, not an afterthought.

Questions about this policy

If you operate a crawler and want to discuss access, or you have a question about how we handle AI systems, email raymond@gocorevantage.com
GoCoreVantage Pte Ltd, UEN: 202621668N