llms.txt and How AI Agents Discover Finmagine

The One File That Tells an AI Agent Everything It Needs to Find, Understand, and Call Finmagine's API

COMPLETE GUIDE

Building with the API? Open the developer docs

Finmagine API & MCP — free tier to test • Pro/Max for full access • REST + MCP

Open the Docs →
← API & Agent Integration Hub ← All Feature Guides
Published: July 29, 2026  |  8 min read  |  Developer Guide  |  API & Agent Integration Series

Multimedia Learning Hub

Master llms.txt and agent discovery through a complete learning overview and interactive flashcards

What You Will Master

Every AI agent that wants to use Finmagine programmatically faces the same first problem: how does it even know Finmagine's API exists, and where does it start? llms.txt is Finmagine's answer — a single, plain-text file at the root of the domain that an agent can fetch first, before it reads a single line of documentation, to get a curated map of everything worth knowing.

What This Guide Covers:

  1. What llms.txt Is — the proposed convention, and the problem it solves that robots.txt and sitemap.xml don't
  2. Why Finmagine Publishes One — 86 operations across REST and MCP is too much for an agent to discover by guessing
  3. Section-by-Section Walkthrough — the actual live file, explained block by block
  4. How an Agent Actually Uses It — a concrete example of the fetch-and-decide flow
  5. llms.txt vs. robots.txt vs. sitemap.xml — three files, three different jobs

Who This Is For:

  • Developers building an AI agent or tool-using LLM app — point your agent's initial context at this file instead of hand-curating a resource list
  • Agent framework maintainers — understand what to expect when your framework crawls a site's llms.txt automatically
  • Anyone curious how Finmagine positions itself for the agentic web — this is the front door

Test Your Knowledge

Click any card to reveal the answer. Use the search box to find a specific topic.

What Is llms.txt?

llms.txt is a proposed web convention — a plain-text, markdown-formatted file published at the root of a domain (https://finmagine.com/llms.txt) whose entire job is to give AI agents and LLM-based tools a curated, high-signal map of a site's most important machine-readable and agent-relevant resources.

The name deliberately echoes robots.txt, and the parallel is intentional: both are small text files sitting at a predictable URL that exist purely to help automated visitors behave sensibly. But they solve completely different problems, which is worth being precise about before going further.

The core idea: A website can have hundreds of pages, but only a handful of URLs actually matter to an agent trying to accomplish something useful — the API spec, the docs, maybe a pricing page. llms.txt is the site owner's own curated shortlist of those URLs, in the order and grouping the owner thinks makes sense, instead of making an agent guess by crawling everything or scraping a sitemap full of noise.

QuestionAnswer
Where does it live?The domain root — /llms.txt, same predictable location as /robots.txt
What format?Plain markdown — headings, a short summary, and grouped bullet lists of links with one-line descriptions
Who reads it?AI agents, agent frameworks, and LLM-based tools — not search engine crawlers, and not humans browsing directly
Is it required?No — it's a voluntary convention, not an enforced standard or a search-ranking signal
It's not magic — it's just a really good first fetch. There's no special protocol handling involved. An agent (or the developer configuring one) simply fetches https://finmagine.com/llms.txt as plain text over HTTP, the same way it would fetch any other URL. The value is entirely in the file being small, curated, and consistently structured — cheap for an agent to read in full and reason about immediately.
THE PROBLEM IT SOLVES

Why Finmagine Publishes One

Finmagine's REST + MCP API currently exposes 86 operations (60 India-market and 60 + 26 US-market operations, to be precise about the current split) covering screening, company research, market breadth, technical scans, and two full multi-agent research systems. That is a genuinely large surface — far too much for an agent to reliably discover by crawling the website's HTML, and far too much to expect a developer to hand-summarise correctly every time the API grows.

Without a curated entry point, an agent (or the person configuring one) is left with bad options: scrape the marketing pages and hope the API is mentioned somewhere, guess at conventional paths like /api or /docs, or rely on a human to manually paste in a list of URLs that goes stale the moment a new endpoint ships. llms.txt replaces all three with one authoritative, versionable file.

This is not the same problem SEO solves. Search engines already have a decade of infrastructure for finding and ranking Finmagine's pages for human searchers. llms.txt exists for a narrower, newer problem: an agent that already knows it's on finmagine.com and needs to figure out, in one fetch, exactly which of the site's resources are safe and useful to act on programmatically.

What Actually Lives at finmagine.com/llms.txt

The file opens with a one-paragraph summary of what Finmagine is, then breaks into five grouped sections: API & Agent Access, Core Research Tools, Guides, Reference, and Optional. Every entry is a markdown link with a short description — enough for an agent to decide whether to follow it without needing to fetch it first.

Section-by-Section Walkthrough

Here is the actual, live content of Finmagine's llms.txt as of this guide's publish date — reproduced in full so you can see exactly what an agent sees on its first fetch.

# Finmagine > Structured market intelligence for Indian (NSE/BSE) and US (NYSE/NASDAQ) equities — screeners, AI-generated company research, and a REST + MCP API built for both human investors and AI agents. Finmagine combines a stock screener (35+ presets, custom conditions, natural-language queries), AI-generated per-company research (scorecards, con-call decoding, management tone analysis), a multi-agent research desk (Strategy Lab + Investment Committee), and an 86-operation REST API with a parallel MCP server for programmatic/agent access. Coverage: 5,000+ Indian and 6,400+ US equities, updated daily. ## API & Agent Access - [OpenAPI Specification](/openapi.json): Full machine-readable contract for all 86 REST/MCP operations — paths, parameters, tiers, and MCP tool mappings per operation. - [Agent Recipes](/agent-recipes.json): 10 curated, verified-executable multi-tool workflows with tier, quota, runtime, and step-by-step chaining hints. - [Compact API Index](/openapi-compact.json): Stripped index for lightweight routing without loading the full spec. - [API Reference](/developer/api-reference.php): Full human-readable reference, generated from the OpenAPI spec. - [API & MCP Documentation](/developer/docs.php): Getting-started guide — auth, rate limits, MCP setup, sample prompts. - [MCP Endpoint](/api/mcp.php): Streamable HTTP (JSON-RPC 2.0 over POST). - [API Explorer](/developer/api-explorer.php): Interactive request builder — try an endpoint live. - [API & MCP Pricing](/developer/pricing.php): Free / Pro / Max tier limits and endpoint access by tier. ## Core Research Tools - [Stock Screener — India](/screen/), [Stock Screener — US](/us/screen/), [Strategy Lab](/strategy-lab/) ## Guides - [All Feature Guides](/blogs/how-to-use-finmagine.php) and specific guides for the Screener, Strategy Lab, AI Advisor, and MCP setup ## Reference - [Financial Glossary](/glossary.php), [Ranking Methodology](/ranking_methodology.php), [FAQ](/faq.php) ## Optional - Consumer pricing, Privacy Policy, Terms of Use

API & Agent Access — the section that matters most

This is the group an agent framework cares about first. Notice the deliberate ordering: openapi.json comes before the human-readable docs, because a framework capable of ingesting an OpenAPI URL directly should be pointed there immediately rather than being routed through prose. agent-recipes.json comes right after — it exists specifically so an agent doesn't have to guess which tools compose into a working chain; the ARCH decision behind it was "give agents a working recipe instead of 86 unconnected tools."

Why both openapi.json AND a compact index? The full OpenAPI spec is comprehensive but large. openapi-compact.json strips it down to just operation ID, path, tier, and required params — enough for an agent doing lightweight routing (e.g. "which endpoint handles this?") without loading the full contract into context. Two different jobs, two different files.

Core Research Tools

These are the actual product surfaces — the screeners and Strategy Lab — for an agent that needs to point a human at a live page rather than call an API directly, or that wants context on what the underlying product does before calling the equivalent API operation.

Guides, Reference & Optional

The last three sections are lower-priority but still curated: feature guides (the same collection this post belongs to), reference material an agent might need to interpret a response (like the Financial Glossary, for explaining a ratio it just fetched), and genuinely optional links like the consumer subscription pricing page — clearly separated from API/MCP pricing so an agent doesn't conflate the two completely different tier systems.

Every link is relative to the description next to it, not to its position. An agent doesn't need to understand section ordering to use this file correctly — each bullet stands alone with enough description to decide relevance. The grouping is there for humans skimming the file, not a required part of how an agent should parse it.

How an Agent Actually Uses It

There's no special protocol here — just a predictable sequence a well-built agent (or the person configuring one) follows:

  1. Fetch https://finmagine.com/llms.txt as plain text — a single, cheap HTTP GET, no auth required.
  2. Parse the markdown — headings become categories, each bullet becomes a candidate resource with a URL and description.
  3. Decide what to load next based on the task. An agent that needs to call the API programmatically follows openapi.json straight away. An agent that needs a human-readable getting-started flow follows /developer/docs.php instead. An agent trying to compose a multi-step workflow without guessing follows agent-recipes.json.
  4. Only then does it fetch the chosen resource — and now it's working from Finmagine's own curated pointer rather than a page it found by chance.
llms.txt is a hint, not an authorization mechanism. Following a link from llms.txt doesn't grant an agent any special access — every API call still needs a real API key (X-Api-Key header), and every operation still respects its own tier gate (Free / Pro / Max). The file only solves discovery, not authentication or authorization.

A Concrete Example

Say you're building an autonomous research agent and you tell it: "Finmagine has data on Indian and US stocks — figure out how to use it." A well-built agent framework would:

That's the entire value proposition in one sentence: llms.txt turns "figure out how to use this site" into "read one small file and follow the pointer."

llms.txt vs. robots.txt vs. sitemap.xml

Finmagine publishes all three, and it's worth being precise about what each one is actually for — they're easy to conflate because they're all small text files at predictable root-level URLs, but they solve unrelated problems.

FileAudiencePurposeAffects SEO?
/robots.txtSearch engine crawlersTells crawlers which paths they may or may not indexYes — directly controls indexing
/sitemap.xmlSearch engine crawlersExhaustive list of every indexable URL, for discovery and rankingYes — helps crawlers find everything
/llms.txtAI agents & agent frameworksA small, curated, human-written map of the resources that actually matter for programmatic/agentic useNo — it's not read by search engines and carries no ranking signal
The key difference is curation, not audience overlap. A sitemap is deliberately exhaustive — every single page, because a search engine benefits from seeing everything. llms.txt is deliberately the opposite: a handful of high-value entries, hand-picked, because an agent benefits from NOT having to sift through hundreds of irrelevant URLs to find the openapi.json link.

What's Next in This Series

llms.txt gets you to the front door. The next two guides in this cluster cover what's immediately behind it:

From there, the series moves into the two zero-code Explorer tools, BYO LLM key setup, and the flagship Investment Committee and Research Preset workflows — see the API & Agent Integration hub for the full roadmap.

Ready to Analyse Indian Stocks Like a Pro?

Finmagine gives you 30+ computed financial ratios, sector benchmarks, FII/DII flows, the Finmagine Score, and AI-powered analysis — all in one place.

Analyse a Stock → Create Free Account
← API & Agent Integration Hub ← All Feature Guides