TRADING4AIStatic crawler and AI-agent discoverability status

Discoverability Status

Pages-only discovery metrics for Financial Agent Reliability Materials.

This page turns crawler readiness into a public artifact. It lists the priority HTML, JSON, text, and XML surfaces that should be fetchable after deployment, while keeping external search indexing separate from local release gates.

Local status

Static surfaces are the unit of measurement.

ModePages only
Priority surfaces38
BackendNot required
BacktestingNot enabled

Capture workflow

How a template becomes a usable external observation record

This sequence is the public handoff for humans and agents. It keeps template placeholders, synthetic examples, and real external observations separated on purpose.

open-discoverability-status

Open the discoverability status surface first

Read the current discoverability status page and JSON artifact before creating a new external evidence record.

Primary artifact: /reliability/discoverability-status.json

copy-template-record

Copy the matching template record

Start from the shared template row for the source you actually used, such as Google Search Console, Bing Webmaster Tools, AI crawler logs, or IndexNow.

Primary artifact: /reliability/external-indexing-evidence-template.json

replace-placeholders

Replace placeholders with observed fields

Replace every placeholder with actual timestamps, URLs, counts, inspection fields, or log fields taken from the external source output.

Primary artifact: /reliability/external-indexing-evidence-template.json

publish-as-observation

Treat the record as one observation, not universal proof

Keep the limitations, source context, and observedAt timestamp attached, and do not upgrade a single external record into ranking, demand, or trust proof.

Primary artifact: /reliability/discoverability-status.json

Accepted payload shapes

top-level object with records[]

top-level array of evidence records

metadata-wrapped public example artifact with top-level records[]

Validation proves the payload shape matches the shared template contract; it does not prove the observation itself is true.

A validator pass does not turn synthetic, stale, or partial source output into external indexing proof.

Keep placeholders, secrets, personal data, and unsupported claims out of the public record before validation.

Priority surfaces

What crawlers and AI agents should be able to fetch

These URLs are the current public discovery set. They are static materials, not request-time judgment endpoints.

SurfaceKindWhy it matters
/htmlmachine-first home surface
/current-capabilitieshtmlcurrent truth boundary
/agent-verificationhtmlFinancial Agent Reliability Materials home
/agent-verification/materialshtmlpublic material pack catalog
/for-agentshtmlmachine-facing integration guide
/llmshtmlhuman-readable machine bridge
/llms.txttextcompact plain-text discovery
/.well-known/agent.jsonjsonagent entry-point card
/robots.txttextcrawler access declaration
/sitemap.xmlxmlsearch engine URL discovery
/discoverabilityhtmldiscoverability status and external indexing checklist
/reliability/public-discovery-registry.jsonjsonmachine-readable registry for public discovery order and recommended reliability starts
/reliability/discoverability-status.jsonjsonmachine-readable discoverability status artifact
/reliability/external-indexing-evidence-template.jsonjsonmachine-readable external indexing evidence capture template
/reliability/external-indexing-evidence-example.synthetic.jsonjsonvalidator-ready synthetic example of a filled external indexing evidence payload
/reliability/public-materials-sample.jsonjsonshared public material catalog artifact
/agent-verification/evidence-cards/libraryhtmlpublic Evidence Card Library index
/reliability/evidence-card-library.jsonjsonpublic Evidence Card Library artifact
/agent-verification/action-preflighthtmlAction Preflight service page
/reliability/action-preflight-sample.jsonjsonAction Preflight static JSON artifact
/agent-verification/evidence-cardshtmlEvidence Cards service page
/reliability/evidence-cards-sample.jsonjsonEvidence Cards static JSON artifact
/agent-verification/reliability-corpushtmlReliability Corpus service page
/reliability/reliability-corpus-sample.jsonjsonReliability Corpus static JSON artifact
/agent-verification/materials/crypto-signal-subscription-packhtmlCrypto signal subscription before payment public material page
/reliability/public-materials/crypto-signal-subscription-pack.jsonjsonCrypto signal subscription before payment pack artifact
/agent-verification/materials/counterparty-screening-packhtmlCounterparty screening before payment public material page
/reliability/public-materials/counterparty-screening-pack.jsonjsonCounterparty screening before payment pack artifact
/agent-verification/materials/wallet-transfer-unverified-counterparty-packhtmlWallet transfer to unverified counterparty public material page
/reliability/public-materials/wallet-transfer-unverified-counterparty-pack.jsonjsonWallet transfer to unverified counterparty pack artifact
/agent-verification/materials/payment-instruction-change-packhtmlPayment instruction change before settlement public material page
/reliability/public-materials/payment-instruction-change-pack.jsonjsonPayment instruction change before settlement pack artifact
/agent-verification/materials/macro-release-context-packhtmlMacro release context packaging public material page
/reliability/public-materials/macro-release-context-pack.jsonjsonMacro release context packaging pack artifact
/agent-verification/materials/public-company-filing-packhtmlPublic company filing review public material page
/reliability/public-materials/public-company-filing-pack.jsonjsonPublic company filing review pack artifact
/agent-verification/materials/claim-safety-packhtmlClaim-safety review before publication public material page
/reliability/public-materials/claim-safety-pack.jsonjsonClaim-safety review before publication pack artifact

Sitemap exclusion policy

Legacy commercial and runtime surfaces stay out of active sitemap discovery

The active sitemap should route search engines and AI agents to current Financial Agent Reliability Materials, static Evidence Cards, public material packs, and machine-readable artifacts.

Mode: exclude_legacy_commercial_runtime_from_active_sitemap

Excluded path prefixes

/pricing

/orders

/delivery

/strategies

/samples

/examples

/api/v1

Allowed handling

Keep legacy commercial/runtime/archive HTML pages noindex, follow when they still need to exist for reference.

Keep legacy API/runtime references only inside agent.json legacy_runtime_surfaces or OpenAPI snapshots, not as active sitemap submissions.

Do not add old strategy, order, pricing, sample, example, or API paths to sitemap.xml unless the public product boundary changes explicitly.

Keyword exposure

Search phrases we want to measure, not claim as achieved

These targets connect the reliability material pages to query families. They are planning and measurement targets until Search Console, Bing, or crawler logs provide external evidence.

measurement_pending

Financial Agent Reliability Materials

broad category discovery for agents and crawlers

Primary URL: /agent-verification

financial agent reliability materials

AI agent financial reliability layer

financial agent evidence materials

measurement_pending

Public Materials Catalog

catalog discovery for static reliability packs and downloadable JSON artifacts

Primary URL: /agent-verification/materials

financial agent public materials

static reliability material packs

AI agent financial material catalog

measurement_pending

Action Preflight Static Review

pre-action reliability checks before risky financial actions

Primary URL: /agent-verification/action-preflight

action preflight financial agent

financial action preflight checklist

AI agent payment preflight review

measurement_pending

Evidence Card Library Index

public index of static Evidence Cards, citations, search intent, and source-quality summaries

Primary URL: /agent-verification/evidence-cards/library

evidence card library

financial agent evidence card index

static evidence card JSON

measurement_pending

Reliability Corpus Failure Patterns

failure-pattern and claim-safety corpus discovery for financial agents

Primary URL: /agent-verification/reliability-corpus

reliability corpus failure patterns

financial agent claim safety corpus

AI trading reliability failure patterns

measurement_pending

Counterparty Screening Evidence Card

pre-payment counterparty review and evidence-card discovery

Primary URL: /agent-verification/materials/counterparty-screening-pack

counterparty screening evidence card

financial agent counterparty screening

payment counterparty evidence pack

measurement_pending

Financial Claim Safety Evidence

safe financial claim restatement and do-not-claim boundaries

Primary URL: /agent-verification/materials/claim-safety-pack

financial claim safety evidence

AI agent financial claim safety

investment claim evidence card

Indexing evidence log

What has been recorded, and what is still waiting on external proof

This ledger keeps local repo verification separate from Search Console, Bing, and AI crawler evidence. Pending records are placeholders until external tools or logs provide observable proof.

recorded

repo release gates

local_verification for /discoverability

Keep local release gates current before each production deployment.

npm.cmd run test:release-gates completed locally

npm.cmd run build completed locally

discoverability status JSON rendered from shared source

recorded

Cloudflare Pages production

production_fetch_verification for /discoverability

Record Search Console URL inspection, crawl, index, impression, or AI-crawler evidence separately now that sitemap-level submission has succeeded.

npm.cmd run deploy:pages:verified:resilient -- --branch main completed against Cloudflare Pages production branch main

Deployment smoke test passed against https://trading4ai.com

Release verification passed with strict runtime alignment

Production discoverability check passed for 12 surfaces: /llms.txt, /llms-full.txt, /reliability/ai-product-facts.json, /reliability/public-materials-sample.json, /reliability/public-materials/counterparty-screening-pack.json, /reliability/public-materials/claim-safety-pack.json, /.well-known/agent.json, /reliability/public-discovery-registry.json, /reliability/discoverability-status.json, /reliability/external-indexing-evidence-example.synthetic.json, /sitemap.xml, and /robots.txt

Source review policy production validation covered sourceReviewPolicyIndex in /llms.txt, /.well-known/agent.json, /reliability/ai-product-facts.json, and /reliability/public-materials-sample.json

Priority pack source review policy validation covered counterparty_screening_pack.sourceReviewPolicy and claim_safety_pack.sourceReviewPolicy in their production JSON artifacts

Production noindex smoke checked 12 legacy commercial/runtime archives and secondary sample archives for noindex, follow

recorded

Google Search Console

search_console_submission for /sitemap.xml

Inspect priority Financial Agent Reliability Materials URLs in Google Search Console and record URL-level crawl, index, and impression evidence separately.

submitted=2026-06-04

last_read=2026-06-04

status=Success

submitted_sitemap_url=https://trading4ai.com/sitemap.xml

discovered_pages=38

evidence_source=Google Search Console Sitemaps report observation provided by the operator

pending_external_record

Bing Webmaster Tools

webmaster_tools_submission for /sitemap.xml

Submit sitemap and inspect the same priority reliability URLs used for Google Search Console.

sitemap submission status

priority URL inspection result

indexed or crawled status

crawl errors when available

pending_external_record

AI crawler/referrer logs

crawler_observation for /llms.txt

Record AI crawler or AI-search referrer evidence when deployment logs or analytics expose it.

crawler user-agent

fetched URL

timestamp

referrer, prompt source, or query when available

ready_for_submission

IndexNow

url_submission_protocol_ready for /sitemap.xml

Deploy the key file, then run npm.cmd run indexnow:submit -- --base-url=https://trading4ai.com --submit and record the response.

public IndexNow key file is available at /b5235403211b48ce9ba2d6ccfe3899fa.txt after deployment

npm.cmd run indexnow:submit builds the submission payload from the shared discoverability priority surfaces

IndexNow URL list excludes noindex legacy commercial/runtime archives and secondary sample archives

recorded

IndexNow

url_submission for /sitemap.xml

Monitor Bing/Webmaster/Search Console/crawler evidence separately and do not treat the 202 response as indexing proof.

npm.cmd run indexnow:submit -- --base-url=https://trading4ai.com --submit

endpoint=https://api.indexnow.org/indexnow

http_status=202

submitted_url_count=34

key_location=https://trading4ai.com/b5235403211b48ce9ba2d6ccfe3899fa.txt

recorded_readiness_gap

Cloudflare Pages API

analytics_access_probe for /discoverability

Use Google Search Console, Bing Webmaster Tools, or enable/provide a Cloudflare analytics/log source before recording AI crawler or referrer observations.

Local env loader found CLOUDFLARE_API_TOKEN in .env without printing the token value

Pages project API returned 200 for accounts/{account_id}/pages/projects/trading4ai

Pages deployments API returned 200 with latest deployment metadata

web_analytics_tag_present=no

web_analytics_token_present=no

zone lookup returned count=0 for trading4ai.com with the current token

recorded_no_stable_public_result

Public web search spot check

public_search_result_spot_check for /agent-verification

Use Google Search Console and Bing Webmaster Tools URL inspection, sitemap, crawl, and performance evidence as the authoritative follow-up record.

query=site:trading4ai.com TRADING4AI Financial Agent Reliability Materials

query=site:trading4ai.com/agent-verification/materials TRADING4AI

query=site:trading4ai.com llms.txt TRADING4AI

query=trading4ai.com

query=TRADING4AI "Financial Agent Reliability"

query="TRADING4AI" "Evidence Cards"

no stable trading4ai.com result observed in the public web-search spot check at this time

External indexing

Repo checks are not search-engine evidence

Google Search Console, Bing Webmaster Tools, and AI crawler logs remain external evidence sources. Their status is tracked here as external_action_required or external_observation_required.

external_action_required

Google Search Console

confirm sitemap remains accepted and inspect priority reliability pages

Record target: google_search_console_submission

Evidence collection policy

collectionInputs

Search Console property access for https://trading4ai.com

submitted sitemap record for https://trading4ai.com/sitemap.xml

URL Inspection output for priority reliability pages

Performance export filtered to Financial Agent Reliability Materials query families

acceptableEvidence

Sitemap status accepted or processed by Google Search Console

URL Inspection result with Last crawl, Crawled as, Page fetch, and Indexing allowed fields

indexed URL status for a priority reliability page

Search performance row containing query, URL, impressions, clicks, country, device, and observed date

unacceptableEvidence

local build or release-gate success

sitemap URL is reachable from a browser or curl only

IndexNow HTTP 202 response

manual claim that Google should discover the page

recordingFormat: recorded

observedAt

submittedSitemapUrl

inspectedUrl

inspectionStatus

lastCrawl

indexingAllowed

query

impressions

clicks

Evidence to record

sitemap accepted

priority URLs crawled

indexed status

search impressions

recorded_external_evidence_available

Google Search Console

record the already observed sitemap Success result separately from URL Inspection evidence

Record target: google_search_console_sitemap_success

Evidence collection policy

collectionInputs

Google Search Console property access for https://trading4ai.com

Sitemaps report row for https://trading4ai.com/sitemap.xml

status, last-read/submitted date, and discovered page count from the Sitemaps report

acceptableEvidence

Google Search Console Sitemaps report showing the submitted sitemap URL, status, and discovered page count

Sitemaps report export or screenshot with source label and capture/export timestamp

unacceptableEvidence

individual URL indexing proof

URL Inspection result treated as the sitemap report

local build or release-gate success

browser or curl reachability of sitemap.xml only

IndexNow HTTP 202 response

recordingFormat: recorded

observedAt

submittedSitemapUrl

sitemapStatus

discoveredPages

sourceLabel

sourceExportedAt

Evidence to record

sitemap status

submitted sitemap URL

discovered page count

source export timestamp

external_action_required

Google Search Console

inspect priority reliability URLs and record URL-level crawl/index fields separately

Record target: google_search_console_url_inspection

Evidence collection policy

collectionInputs

Google Search Console property access for https://trading4ai.com

URL Inspection output for one priority reliability URL at a time

captured URL, page fetch, last crawl, crawled-as, indexing allowed, and source timestamp

acceptableEvidence

Google Search Console URL Inspection result for a named TRADING4AI URL

URL Inspection output with Page fetch, Last crawl, Crawled as, Indexing allowed, and inspected URL

unacceptableEvidence

Search performance row treated as URL Inspection

Sitemaps report treated as individual URL indexing proof

local production smoke test only

browser or curl reachability of the page only

recordingFormat: recorded

observedAt

inspectedUrl

inspectionStatus

pageFetch

lastCrawl

crawledAs

indexingAllowed

sourceLabel

sourceExportedAt

Evidence to record

inspected URL

inspection status

page fetch

last crawl

crawled as

indexing allowed

external_action_required

Google Search Console

export Search Performance rows for reliability-material queries and record query-level impressions/clicks separately

Record target: google_search_console_search_performance

Evidence collection policy

collectionInputs

Google Search Console Performance report access for https://trading4ai.com

query/page/date/country/device filtered export for Financial Agent Reliability Materials pages

captured date range, query, URL, impressions, clicks, and source timestamp

acceptableEvidence

Google Search Console Performance row with query, page URL, date range, impressions, clicks, country, and device

Search Performance export preserving source label and export timestamp

unacceptableEvidence

URL Inspection result treated as Search performance

Sitemaps report status treated as impressions or clicks

manual claim that a page should rank

local production smoke test only

recordingFormat: recorded

observedAt

query

pageUrl

dateRange

impressions

clicks

country

device

sourceLabel

sourceExportedAt

Evidence to record

query

page URL

date range

impressions

clicks

country

device

external_action_required

Bing Webmaster Tools

submit https://trading4ai.com/sitemap.xml and inspect priority reliability pages

Record target: bing_webmaster_tools_submission

Evidence collection policy

collectionInputs

Bing Webmaster Tools property access for https://trading4ai.com

submitted sitemap record for https://trading4ai.com/sitemap.xml

URL Inspection output for priority reliability pages

crawl or search performance export when available

acceptableEvidence

Bing sitemap submission status with submission or processed timestamp

URL Inspection result with crawl, index, robots, and canonical fields

crawl error report for a priority reliability URL

search performance row containing query, URL, impressions, clicks, and observed date

unacceptableEvidence

IndexNow submission accepted without a Bing crawl or index observation

local production smoke test only

reachable sitemap URL without Bing Webmaster processing status

unverified screenshot without URL, timestamp, or tool context

recordingFormat: recorded

observedAt

submittedSitemapUrl

inspectedUrl

crawlStatus

indexStatus

crawlErrors

query

impressions

clicks

Evidence to record

sitemap accepted

priority URLs crawled

indexed status

crawl errors

external_observation_required

AI crawler/referrer logs

record AI crawler or referrer evidence when logs or analytics are available

Record target: ai_crawler_referrer_observation

Evidence collection policy

collectionInputs

Cloudflare Web Analytics, access logs, server logs, or crawler/referrer analytics source

filter for /llms.txt, /.well-known/agent.json, /for-agents, /discoverability, and reliability material pages

user-agent and referrer fields when available

time window and sampling boundary

acceptableEvidence

observed request with user-agent, fetched URL, status code, and timestamp

AI search or agent referrer row tied to a reliability material URL

crawler fetch of llms.txt or agent.json followed by reliability material page fetches

analytics export preserving source, URL, and observed time

unacceptableEvidence

hypothetical AI crawler interest

manual browser visit by the project owner

generic traffic count without URL or source fields

claim that a chatbot could use the site without observed fetch or citation evidence

recordingFormat: recorded

observedAt

source

userAgent

referrer

fetchedUrl

statusCode

requestCount

timeWindow

Evidence to record

crawler user-agent

fetched URL

timestamp

referrer or query when available

external_observation_required

AI search answer citation

query AI search/answer surfaces and record whether they cite expected TRADING4AI reliability URLs

Record target: ai_search_answer_citation_observation

Evidence collection policy

collectionInputs

A named AI search or answer surface such as Gemini, Claude, Perplexity, ChatGPT Search, Doubao, or another comparable surface

Exact query from monitoringLoop.searchQueryEvidenceMatrix

Expected TRADING4AI URL and any cited URL returned by the answer

Answer excerpt, capture timestamp, account/region context when available, and source label

acceptableEvidence

Observed AI answer for an exact query with platform, timestamp, answer excerpt, and cited URL

AI search result or answer citation that includes the expected TRADING4AI URL or a clearly related TRADING4AI material URL

Export or screenshot transcript preserving query, answer, cited URL, platform, and capture time

unacceptableEvidence

manual belief that AI systems should find the site

a prompt drafted but not executed on an AI search/answer surface

a generic answer that paraphrases TRADING4AI without cited URL evidence

manual browser reachability or local production smoke test

recordingFormat: recorded

observedAt

aiPlatform

query

expectedUrl

citedUrl

citationPresent

answerExcerpt

accountRegion

sourceLabel

sourceExportedAt

Evidence to record

AI platform

query

expected URL

cited URL

answer excerpt

timestamp

submitted_external_recorded

IndexNow

monitor crawler, index, impression, click, or referrer evidence after the accepted IndexNow submission

Record target: indexnow_submission_2026_06_03

Evidence collection policy

collectionInputs

IndexNow key file URL and key value stored outside public logs

generated priority URL list from the shared discoverability surfaces

submission endpoint response status

follow-up Bing/Webmaster or crawler observations

acceptableEvidence

IndexNow endpoint HTTP status, submitted URL count, endpoint, and observed timestamp

online key-location check for the public key file

follow-up crawl, index, impression, click, or referrer evidence from a separate external source

submitted URL list generated from non-noindex priority surfaces

unacceptableEvidence

IndexNow accepted response treated as ranking proof

IndexNow accepted response treated as indexing proof

manual URL list not generated from the shared discovery contract

repeat submission without changed URLs or updated evidence

recordingFormat: recorded

observedAt

endpoint

httpStatus

submittedUrlCount

keyLocation

submittedUrlsSource

followUpEvidenceSource

Evidence to record

submitted URL count

endpoint

HTTP status

observed at

response body if provided

Local check

npm.cmd run test:release-gates

typecheck, machine contract, ops scripts, worker smoke, and static discovery checks are aligned locally

Local check

npm.cmd run build

Next.js can statically build the public Pages-only site

Local check

node scripts/check-reliability-discovery-drift.mjs

llms.txt, agent.json, and sitemap.xml match the shared discovery renderer

Boundaries

This artifact proves only the repo-owned static discovery contract and intended external indexing workflow.

Passing local gates does not prove search engines have indexed the site.

Keyword targets are planning and measurement targets, not proof that rankings, impressions, clicks, or demand already exist.

Indexing evidence records with pending_external_record status are placeholders for future external proof, not proof by themselves.

Crawler visits do not prove product demand by themselves.

No live backend judgment, backtesting, trading execution, scraping pipeline, or compliance clearance is implied.