Indian Knowledge
Systems Division
A scholar-verified index of the names, peoples and places of the Paurāṇic corpus — beginning with the Harivaṃśa, the largest unindexed book in Sanskrit literature, and the apparatus that makes a small team's reading enough to build one.
The gap
Ask where Ambarīṣa appears across the corpus, or which Purāṇas know a particular tīrtha, or whether a lineage is told the same way in Vāyu and in Brahmāṇḍa, and there is no way to answer except by reading. The eighteen Mahāpurāṇas have translations, editions, and concordances of individual texts. They have no index of proper names spanning the corpus.
The consequence is quiet but severe. Comparative Paurāṇic study — the study of how the same figure, dynasty or sacred site is handled across texts — is presently done from memory and from whichever text a scholar happens to know well. Claims about Paurāṇic tradition circulate without a way to check their extension.
The absence is not of scholarship. It is of an apparatus that lets scholarship be checked.
The precedent, and its form
Sören Sorensen's Index to the Names in the Mahābhārata (1904–1925) is the reason Mahābhārata scholarship can be argued rather than asserted. It carries 12,647 entries over 8,981 distinct names, with 4,861 aliases and epithets, each entry typed, glossed, and cited to the verse. A second, independent index — the Gītā Press Hindi nāmānukramaṇikā — covers 4,625 headwords in the same corpus and cross-checks the first.
Sorensen's own entries already carry the type as prose, which is why the category system below is his and not ours:
a people in the west of India upon the Indus (II, 32, 1192); are conquered by Nakula at his Digvijaya; bring tribute to Yudhiṣṭhira (II, 51, 1832). Mārkaṇḍeya prophesies that in the Kali-yuga there shall be many Ābhīra and other barbarous kings (III, 188, 12840) … (cf. Wilson, Viṣṇu-purāṇa, ed. by Fitzedward Hall, vol. ii, 133 f.)
What Sorensen did for 83,966 verses over two decades of reading, no one has attempted for the 367,324 that lie beyond where he stopped — beginning, as section III shows, with the very next book of the edition he was reading.
Why it has not been done
The Purāṇa corpus is digitised and addressable. What has never been available is a way to put a trained reader in front of the right verses instead of all of them.
| Purāṇa | Verses | Chapters | Ch. with topic labels |
|---|---|---|---|
| Skanda | 94,483 | 1,756 | 1,694 |
| Padma | 49,326 | 693 | 693 |
| Bhaviṣya | 25,994 | 585 | 585 |
| Śiva | 22,606 | 423 | 423 |
| Brahmavaivarta | 20,598 | 275 | 275 |
| Bhāgavata | 14,488 | 341 | 341 |
| Mārkaṇḍeya | 6,198 | 134 | 134 |
| Viṣṇu | 6,258 | 126 | 126 |
| …and ten others | 111,274 | 2,174 | 2,169 |
| Total | 351,225 | 6,507 | 6,440 (99.0%) |
Those 12,098 Sanskrit topic labels matter more than their modest size suggests. They are the corpus naming its own contents in its own language, and they are where a Paurāṇic name list begins — not from an English category scheme imposed from outside.
The Harivaṃśa is the khila — the supplement transmitted with the Mahābhārata, printed in the same editions, carrying the same commentary, and Paurāṇic in everything but attachment. At 16,099 verses it is the largest single book in the epic corpus, and it holds 4,034 distinct candidate names, a larger name inventory than any parvan of the epic proper.
Sorensen indexed parvans I through XVIII and stopped. Not one of his 12,647 entries carries a Harivaṃśa citation. The Gītā Press nāmānukramaṇikā stops in the same place — the Harivaṃśa is absent from it entirely. So the unindexed territory begins not at the edge of the Purāṇas but inside the epic's own covers, in the text that leads into them.
Why the shortcut fails
The obvious modern shortcut is to train a named-entity recogniser and run it over the corpus. The current state of the art shows precisely why that is not sufficient on its own.
Naamah (Kulkarni & Rajeev P, C-DAC Bangalore, 2026) is the largest Sanskrit NER corpus yet assembled: 102,942 sentences and 732,267 tokens, generated by prompting a large language model with entity seeds drawn from DBpedia. It reports 0.9615 F1. It is careful, useful work, and its authors state its limits plainly:
Nobody knows what such a model does on an anuṣṭubh of thirty-two syllables dense with compounds, because the measurement does not exist. Naamapadam, the standard Indic NER resource, does not cover Sanskrit at all.
What has changed
Rather than begin on an unindexed corpus, the method was built and measured where a gold index already exists to check it against. Every figure below is from a completed run over the epic.
| Component | Result | Measure |
|---|---|---|
| Gītā Press citation resolver | Hindi index citations resolved to a live verse address | 91.5% |
| Verified seed | Verses where the indexed name is confirmed present in the verse | 16,005 |
| Sorensen citation resolver | Name found in the cited adhyāya (83.2% within ±3) | 77.5% |
| Candidate mention scan | Attestations over epic + Purāṇas, whole corpus, 12.7 min | 2,278,617 |
| Type extraction from Sorensen | Entries typed from the entry's own opening phrase, first pass | 64.6% |
| Typed place gazetteer | Tīrtha, river, mountain, city, lake, forest, kingdom/region | 1,348 |
Two findings drive the proposal. First, Sorensen's category system is recoverable from his own prose — his entries open formulaically (a tīrtha, a river, a people, an ancient king, a ṛṣi, an asura), so the type inventory is inherited from a philologist rather than invented. Second, the scan is fast and the corpus is small in machine terms; the entire Purāṇa corpus was already scanned in minutes. Neither of these is the bottleneck.
Method
Parse Sorensen's entry openings into an explicit category field, with Gītā Press senses and the existing typed gazetteer as cross-checks. Output: a typed, alias-linked lexicon of roughly 13,000 names carrying a philologist's own classification.
Mine the 12,098 Sanskrit chapter topic labels for names the epic lexicon does not know. The Purāṇas name their own contents; this is where headwords absent from Mahābhārata scholarship enter.
Scan the corpus for every occurrence, in Devanagari with sandhi-aware matching, recording verse address, surface form, word position and a confidence signal. Each candidate keeps its possible senses as an unresolved set. The machine proposes; it never decides which Citrasena.
Candidates are presented verse by verse, in context, with translation and commentary alongside. A reader confirms, rejects, and adds what the machine missed; contested and structural cases escalate to a senior scholar who divides the senses and writes the entry. This is the step that turns a large noisy pool into a gold index, and there is no substitute for it. Every decision is recorded against its evidence and its author, so the index is auditable entry by entry. How this step is staffed is set out in section VIII.
Verified entries become the index. The same verified spans become a gold annotated corpus, which trains a tagger, which proposes better candidates for the next Purāṇa. Scholar effort per text falls as the corpus grows.
The output
The form follows Sorensen deliberately, so that the two indexes can be read together. Below, the parts a machine supplies and the parts only a scholar can supply are set apart — which is also the honest picture of where the work goes.
Sorensen's seven senses, for parvans I–XVIII only:
1. brother of Janamejaya · 2. a Devagandharva · 3. a prince · 4. a son of Dhṛtarāṣṭra · 5. son of the elder Parikṣit · 6. (probably the same as Āhuka), king of the Vṛṣṇis, father of Kaṃsa · 7. = Janaka, III, †10651
derived: Ugrasenasuta (“the son of Ugrasena⁶”) = Kaṃsa — I, 2703, V, 4296
What the pilot adds: sense 6 is the Vṛṣṇi king whose story the Harivaṃśa carries at length, and sense 4 is a Kaurava of the Ādi Parva. Every Harivaṃśa attestation of उग्रसेन is currently unindexed and unassigned — the machine can locate them and can say only that seven claimants exist. Which of the seven stands in a given verse is the scholar's ruling, and it is the ruling that makes the entry worth having.
Senses 1–7 and the Ugrasenasuta cross-reference are Sorensen's own, quoted from the parsed index. The Harivaṃśa continuation is what does not yet exist and is what the pilot would produce. This headword is also a live illustration of the escalation rule in section VIII: seven claimants means no first-pass reader is asked to decide alone.
Typed headwords with aliases, sense divisions, glosses and verse-addressed citations, released as structured data and as a readable reference — usable by a scholar with no software at all.
Every verified attestation is a hand-checked, typed span in real classical Sanskrit — the evaluation set the NER literature explicitly lacks, and the yardstick synthetic corpora can finally be measured against.
Extraction code, the adjudication interface, and a decision log recording who accepted what on what evidence. A reviewer can re-derive any entry from the published verse text.
A model trained on the gold spans, with its performance reported on classical text rather than on generated sentences — and used to lower the reading cost of the next Purāṇa.
Who does the reading
The reading in stage IV is not one task. Deciding whether a token in a verse is an occurrence of a given name is a fast, well-defined judgement that a competent Sanskrit reader makes correctly and quickly. Deciding that a name carries two distinct senses, writing the gloss that separates them, and reconciling the result with Sorensen is a different order of work. Conflating the two is what has always made an index of this size look unaffordable.
First-pass adjudication of candidate attestations, in context, verse by verse. Confirm, reject, or mark for escalation; add occurrences the machine missed. Every decision is signed and every annotator's accuracy is measurable against the overlap sample.
Sense division, gloss authorship, contested identifications, reconciliation with Sorensen and Gītā Press, and sign-off on every published entry. Seniority is spent on the cases that are actually hard, not on confirming that अम्बरीष is Ambarīṣa.
The known failure of tiered annotation is a junior annotator not recognising a hard case. So the hard cases are identified by the system, not by self-assessment. A candidate leaves the first pass and goes to the senior scholar whenever:
A student who spends a season adjudicating Paurāṇic attestations has read a great deal of Purāṇa closely, with commentary and translation at hand, under a senior scholar's correction — and emerges with named credit in a published scholarly apparatus. That is a route from pāṭhaśālā training into research authorship that presently barely exists, and the project produces it as a matter of course rather than as an add-on.
Pilot
The pilot takes two adjacent books of the same corpus, in the same edition, the same addressing and the same commentarial tradition. One is the most thoroughly indexed book in Sanskrit literature. The other has never been indexed at all.
| Phase | Verses | Candidate names | Spans to adjudicate | Existing index |
|---|---|---|---|---|
| A · Ādi Parva calibration | 8,623 | 3,471 | 12,190 | Sorensen in full; Gītā Press 1,269 headwords over 3,554 verses — the densest coverage in the corpus |
| B · Harivaṃśa production | 16,099 | 4,034 | 24,356 | None. Absent from Sorensen and from Gītā Press alike |
Every quality claim about an index of an unindexed text runs into the same wall: there is nothing to check it against. This pair removes that wall. Phase A is scored against two independent gold indexes — reader accuracy, machine recall, escalation rate and inter-annotator agreement are all measured against Sorensen and Gītā Press, on real verses, by the same team that will then work unsupervised. Phase B carries those measured figures across a seam narrower than any other in Sanskrit literature: the next book of the same printed edition, in the same transmission, with the same commentator alongside.
No pair of Purāṇas can offer that, because no Purāṇa has a gold index to calibrate against. Beginning anywhere else means asserting an error rate; beginning here means measuring one and then carrying it.
The Harivaṃśa earns its place on its own account as well. It is vaṃśa — genealogy is its subject, which is why it holds the corpus's richest name inventory. And its Kṛṣṇa material is the direct textual ancestor of Viṣṇu Purāṇa V and Bhāgavata X, so the pilot's headwords reach into the Purāṇa corpus proper from the day they are published.
Afterlife
The ask
The computational work is largely done and has been proved against a gold index. What this proposal requests is the one thing that cannot be automated and has never been resourced: sustained, trained, attributed reading — and, with it, the chance to bring young scholars of the pāṭhaśālā tradition into published research on the strength of the training they already have.
The index is not the end of the work. It is the instrument that lets a century of subsequent work be done, and checked.