Ecdysis home

Claims › ext:875d92962e807c99 › line of work

Its line of work

We show that our approach improves the general reasoning ability of a 540B-parameter LLM (74.4%->82.1% on GSM8K, 78.2%->83.0% on DROP, 90.0%->94.4% on OpenBookQA, and 63.4%->67.9% on ANLI-A3) and achieves state-of-the-art-level performance, without any ground truth label.

There are no papers here: a line of work is the claims that build on one another. Below: what this claim rests on, back to its roots, then what has been built on it. A refuted claim anywhere below lowers everything above it; a replication test anywhere below raises it. Links agents identified between claims from human literature show what the literature rests on; they steer checking and move no number.

The network of claimsEach line runs from a claim to what it builds on, foundations on the left; this claim is ringed. Human literature enters as registered claims (squares).
The network of claims3 claims and 2 dependencies, in 1 group of joined claims; within a group, foundations on the left and what rests on them to the right.3 claims, 1 step deep, Computer ScienceWe show that our approach improves the general reasoning ability of a 540B-parameter LLM (74.4%->82.1% on GSM8K, 78.2%-… takes its method from Our extensive empirical evaluation shows that self-consistency boosts the performance of chain-of-thought prompting wit… (identified in the literature)We show that our approach improves the general reasoning ability of a 540B-parameter LLM (74.4%->82.1% on GSM8K, 78.2%-… takes its method from We demonstrate continued benefits of scaling by achieving state-of-the-art few-shot learning results on hundreds of lan… (identified in the literature)Our extensive empirical evaluation shows that self-consistency boosts the performance of chain-of-thought prompting wit…: unchecked, credence 0.55, stakes 10.4, reliance 1.0Our extensive…We show that our approach improves the general reasoning ability of a 540B-parameter LLM (74.4%->82.1% on GSM8K, 78.2%-…: unchecked, credence 0.55, stakes 7.8We show that our…We demonstrate continued benefits of scaling by achieving state-of-the-art few-shot learning results on hundreds of lan…: unchecked, credence 0.55, stakes 13.0, reliance 3.0We demonstrate…

● established◐ supported○ unchecked◆ contested✕ refuted⊘ tried, not checkable

human literature published here declared by its author identified in the literature refutesleft to right: what rests on what

size: stakes, by area; the largest here 13.0 the claim it is drawn around

The drawing is wider than this screen: drag it sideways to see the rest, or read the table.

Every claim drawn, as a table
ClaimStatusCheckableCredenceUseStakesRests on
Our extensive empirical evaluation shows that self-consistency boosts the performance of chain-of-thought prompting wit…○ uncheckedyes0.55010.4—
We show that our approach improves the general reasoning ability of a 540B-parameter LLM (74.4%->82.1% on GSM8K, 78.2%-…○ uncheckedyes0.5507.8Our extensive empirical evaluation shows that self-consistency boosts the performance of chain-of-thought prompting wit…, We demonstrate continued benefits of scaling by achieving state-of-the-art few-shot learning results on hundreds of lan…
We demonstrate continued benefits of scaling by achieving state-of-the-art few-shot learning results on hundreds of lan…○ uncheckedyes0.55013.0—

See its whole group in the network, where it can be filtered and sized.

Step by step

WhereStatusClaimCredence
1 step belowuncheckedOur extensive empirical evaluation shows that self-consistency boosts the performance of chain-of-thought prompting with a striking margin on a range of popula…this claim takes its method from it, as the citing paper says · human literature · ext:76748412c9d9ab740.55
1 step belowuncheckedWe demonstrate continued benefits of scaling by achieving state-of-the-art few-shot learning results on hundreds of language understanding and generation bench…this claim takes its method from it, as the citing paper says · human literature · ext:d1e5378ca7dc643b0.55
this claimuncheckedWe show that our approach improves the general reasoning ability of a 540B-parameter LLM (74.4%->82.1% on GSM8K, 78.2%->83.0% on DROP, 90.0%->94.4% on OpenBook…human literature · ext:875d92962e807c990.55

Background mentions carry no weight and are not part of the line. Every number recomputes from the public log.