Medium

medium.com

-16
blocked

Category: Content & News · ranked #6 in category

Scanned 6/7/2026, 1:16:19 PM

How to access Medium as an agent

  1. Identify yourself at the edge before doing anything else

    This site is protected by bot management. Anonymous scans see nothing because every request is challenged or blocked. Even if you have valid OAuth or API credentials, you'll need to either (a) be on the operator's allowlist, (b) sign your requests via Web Bot Auth so the bot-management product can recognize you, or (c) request inclusion in the verified-bots / signed-agents directory the operator uses.

  2. Check for an undocumented developer API

    No OpenAPI at the standard paths. Look for /developer, /developers, /docs, /api for hand-authored documentation.

    https://medium.com/developers
  3. Find the developer signup

    No standard OAuth discovery - most sites still have a developer-portal signup. Find the OAuth client registration page on their site.

  4. Publish your own agent identity

    Generate an Ed25519 keypair, host a public key directory, sign your HTTP requests (Web Bot Auth), apply to Cloudflare's bots & agents directory if you cross their edge.

    https://developers.cloudflare.com/bots/concepts/bot/verified-bots/
  5. Respect robots.txt and Content Signals

    Even when you are an approved agent, honor the site's policy preferences. Cache them; refresh weekly.

What we found

SignalStatusEvidencePoints
blocked_by_bot_managementfound
Edge-protected by Cloudflare Bot Management. cf-mitigated="challenge" (status 403). The scanner can only see what reaches the application - if you protect with bot management, expect agents to be unable to discover your well-known files even if you publish them.
medium.com/-20
robots_allowsfound
9 UA rules · sitemap: yes
medium.com/robots.txt+4
Show 13 signals not present
  • · llms_txt (+5 if found)
  • · llms_full_txt (+3 if found)
  • · agents_txt (+6 if found)
  • · agents_json (+15 if found)
  • · a2a_agent_card (+25 if found)
  • · agents_md (+4 if found)
  • · openapi (+18 if found)
  • · oauth_discovery (+12 if found)
  • · content_signals (+5 if found)
  • · ai_plugin_json_legacy (+0 if found)
  • · mcp_registry (+25 if found)
  • · in_llms_txt_hub (+0 if found)
  • · in_agent_friendly_directory (+4 if found)

If you own this site

Concrete moves that would raise Medium's AgentRank:

  • Publish /llms.txt - a curated markdown index of your useful docs for LLMs.
  • Publish /agents.txt declaring which agent protocols you support.
  • If you operate an agent, publish /.well-known/agent-card.json so others can discover it.
  • Publish /AGENTS.md with human-readable agent instructions.
  • Publish your API as OpenAPI 3.x at a discoverable location.
  • Expose OAuth/OIDC discovery at /.well-known/oauth-authorization-server.