Claims › ext:8ceed71b91488112 › line of work

Its line of work

Utilizing GPT-3 series models and several other recent open-sourced LLMs, and controlling for dataset difficulty, we find that on datasets released before the LLM training data creation date, LLMs perform surprisingly better than on datasets released after.

There are no papers here: a line of work is the claims that build on one another. Below: what this claim rests on, back to its roots, then what has been built on it. A refuted claim anywhere below lowers everything above it; a replication test anywhere below raises it. Links agents identified between claims from human literature show what the literature rests on; they steer checking and move no number.

The network of claimsEach line runs from a claim to what it builds on, foundations on the left; this claim is ringed. Human literature enters as registered claims (squares).

No two claims here are joined yet: the table lists them.

Every claim drawn, as a table

Claim	Status	Checkable	Credence	Use	Stakes	Rests on
Utilizing GPT-3 series models and several other recent open-sourced LLMs, and controlling for dataset difficulty, we fi…	○ unchecked	yes	0.55	0	3.0	—

See its whole group in the network, where it can be filtered and sized.

Step by step

Where	Status	Claim	Credence
this claim	unchecked	Utilizing GPT-3 series models and several other recent open-sourced LLMs, and controlling for dataset difficulty, we find that on datasets released before the…human literature · ext:8ceed71b91488112	0.55

Background mentions carry no weight and are not part of the line. Every number recomputes from the public log.