Does Kosmico claim every specialist feature is stronger?
No. The claim being tested is workflow integration. Specialist tools may remain preferable for particular capabilities or established institutional processes.
Workflow comparison
Kosmico's design bet is that research improves when specialist surfaces share one project state and the agent can act across them with explicit permissions.
Zotero, Overleaf, notebooks, academic databases, and team chat each solve important problems. A team may prefer them for established workflows, institutional integrations, or a specific specialist capability.
Manual actions, application switches, duplicated context, stale copies, recovery after interruption, and artifact completeness are benchmark outcomes, not cosmetic details. The controlled benchmark holds the model and corpus constant to measure that workflow layer.
| Criterion | Kosmico | Conventional stack |
|---|---|---|
| Context | One project context selected for the task | Context copied or reconnected across applications |
| Artifacts | Literature, notes, code, references, and manuscript in one project | Artifacts remain in their specialist tools |
| Automation | Agent actions across supported project surfaces and permissions | Integrations, exports, scripts, and manual handoffs |
| Control | One workspace policy and project permissions | Independent permissions, storage, and policies per service |
Official source
Kosmo can chain many steps on its own, but only with the tools of the active mode: a tool outside the mode is refused. Every run has a fixed budget of tool turns, from 10 to 50 depending on where Kosmo runs (20 in the desktop chat, 50 on the web), and ends with a written answer when the budget runs out. Helper sub-agents are read-only and get 5 to 8 turns.
Cloud models come from a catalogue Kosmico manages and are included in your plan, metered as tokens. Free plans get the free models; paid plans unlock the rest. The catalogue is updated from the admin dashboard, so the list can change between releases.
Citation identity
Every citation comes from a record fetched from one of the databases, and you can open it. The review may cite only papers found in the run: a section with an unknown reference, or a substantive paragraph without a citation, is rejected and rewritten. An optional pass also resolves each reference by DOI, arXiv ID, PubMed ID or title and flags the ones it cannot confirm.
Claim-to-evidence validation
A claim taken from a paper's full text is kept only if its quoted passage appears on the cited page; claims without a matching quote are dropped. Each section is written from the evidence of the papers it cites, but no model checks that every sentence of the review is supported, so check the sources of anything you are about to publish.
No. The claim being tested is workflow integration. Specialist tools may remain preferable for particular capabilities or established institutional processes.
The benchmark measures completion, wall and human time, manual actions, application switches, artifact completeness, recovery, evidence quality, and cost across both real-world and controlled conditions.