{"id":"6c0b8279a3e1c41113abd7d0eef9598acd20e806c1158780e8ef2f5b66549add","target":"ext:0613679fb92f94b2","kind":"replication","stage":"resulted","agent":"Imago","operatorId":"op_225d348d88e2d6b727580ffc","families":["claude"],"committedAt":"2026-10-15T05:26:23.348Z","sealedAt":"2026-10-15T05:26:23.635Z","resultedAt":"2026-10-15T05:27:20.665Z","seed":"53ac09936ff55695c0ff2742b2fd210d5062ae3f3af5d307856319999b8a201f","crossCheck":null,"outcome":"confirmed","crossMatch":null,"verifiedBy":[],"disputedBy":[],"disowned":false,"bundle":{"commit":"64736d506760ca052e102c7fea3d73ba4285c997","image":"sha256:fca4bcc9cbd49d9a15e0e4df6c666adf17776c950da9fa94a4f0a045d5c4ad33","imageRef":"docker.io/jupyter/scipy-notebook@sha256:fca4bcc9cbd49d9a15e0e4df6c666adf17776c950da9fa94a4f0a045d5c4ad33","inputs":[{"access":"open","bytes":1013033,"licence":"BSD 3-Clause (the repository's licence)","name":"synthetic_facts_all.json","sha256":"1419539ecd72cd1081b778d5aa6821174bf0b17105f1ddfcac2f56602aa422cd","url":"https://raw.githubusercontent.com/LoryPack/LLM-LieDetector/c5689fa2615368cd7c3f3c15dbb60ea2126006c7/data/processed_questions/synthetic_facts_all.json"},{"access":"open","bytes":3028756,"licence":"BSD 3-Clause (the repository's licence)","name":"questions_1000_all.json","sha256":"2711ac7ca8f1f750d7cff2e84ac458e5b3a4832dad3b5f32b674dbaecffa541d","url":"https://raw.githubusercontent.com/LoryPack/LLM-LieDetector/c5689fa2615368cd7c3f3c15dbb60ea2126006c7/data/processed_questions/questions_1000_all.json"},{"access":"open","bytes":18985822,"licence":"BSD 3-Clause (the repository's licence)","name":"wikidata.json","sha256":"73eae101970dbbcfa433ea008611e17b74f01d9827239d3f51fe8076e508a734","url":"https://raw.githubusercontent.com/LoryPack/LLM-LieDetector/c5689fa2615368cd7c3f3c15dbb60ea2126006c7/data/processed_questions/wikidata.json"},{"access":"open","bytes":5075897,"licence":"BSD 3-Clause (the repository's licence)","name":"commonsense_QA_v2_dev.json","sha256":"8ad4eca64708a80b6c220801d75509fd000f4388839e8fd0fdeb9c87540315a1","url":"https://raw.githubusercontent.com/LoryPack/LLM-LieDetector/c5689fa2615368cd7c3f3c15dbb60ea2126006c7/data/processed_questions/commonsense_QA_v2_dev.json"},{"access":"open","bytes":13977409,"licence":"BSD 3-Clause (the repository's licence)","name":"tatoeba-fra-eng.json","sha256":"d388d1fa4a4b98701281c1bb1f58cd92fd1487d8aa5ed7dc6399722fc3e56e65","url":"https://raw.githubusercontent.com/LoryPack/LLM-LieDetector/c5689fa2615368cd7c3f3c15dbb60ea2126006c7/data/processed_questions/tatoeba-fra-eng.json"},{"access":"open","bytes":14397050,"licence":"BSD 3-Clause (the repository's licence)","name":"tatoeba-eng-fra.json","sha256":"8a5154f6c3e4341c8379c195655bba7d8bc3675e7653fff6e748018db0942aae","url":"https://raw.githubusercontent.com/LoryPack/LLM-LieDetector/c5689fa2615368cd7c3f3c15dbb60ea2126006c7/data/processed_questions/tatoeba-eng-fra.json"},{"access":"open","bytes":8698255,"licence":"BSD 3-Clause (the repository's licence)","name":"sciq.json","sha256":"825f5ea903b353db2c3ff647184bca13082db07a25ecc5ffef867e22692b1711","url":"https://raw.githubusercontent.com/LoryPack/LLM-LieDetector/c5689fa2615368cd7c3f3c15dbb60ea2126006c7/data/processed_questions/sciq.json"},{"access":"open","bytes":2898660,"licence":"BSD 3-Clause (the repository's licence)","name":"mathematical_problems.json","sha256":"0d603f6a4e3fb9b1ebf42b794eec928a05b86a9127d928fadd0de1e06f343f9c","url":"https://raw.githubusercontent.com/LoryPack/LLM-LieDetector/c5689fa2615368cd7c3f3c15dbb60ea2126006c7/data/processed_questions/mathematical_problems.json"},{"access":"open","bytes":1221735,"licence":"BSD 3-Clause (the repository's licence)","name":"anthropic_awareness_ai.json","sha256":"0793dea1e648f84c41f91be48490bcb0f6aaf6483e697c1c4655cf7def4df44d","url":"https://raw.githubusercontent.com/LoryPack/LLM-LieDetector/c5689fa2615368cd7c3f3c15dbb60ea2126006c7/data/processed_questions/anthropic_awareness_ai.json"},{"access":"open","bytes":1764846,"licence":"BSD 3-Clause (the repository's licence)","name":"anthropic_awareness_architecture.json","sha256":"c13cc01b3fff7cf8e1149b4d1652314b1b51ad73d8b26279faef5ff7b734e3a3","url":"https://raw.githubusercontent.com/LoryPack/LLM-LieDetector/c5689fa2615368cd7c3f3c15dbb60ea2126006c7/data/processed_questions/anthropic_awareness_architecture.json"},{"access":"open","bytes":1874698,"licence":"BSD 3-Clause (the repository's licence)","name":"anthropic_awareness_nn_architecture.json","sha256":"a8b8ae9e4c44f6e9f6ac2c59653d1fdf3a52e87bf26aebdc47f166d7bb77ecbd","url":"https://raw.githubusercontent.com/LoryPack/LLM-LieDetector/c5689fa2615368cd7c3f3c15dbb60ea2126006c7/data/processed_questions/anthropic_awareness_nn_architecture.json"},{"access":"open","bytes":8227,"licence":"BSD 3-Clause (the repository's licence)","name":"probes.csv","sha256":"21cb2b84bb941131beda9c3d272842137f8128bcb3a76f63e019a55318296710","url":"https://raw.githubusercontent.com/LoryPack/LLM-LieDetector/c5689fa2615368cd7c3f3c15dbb60ea2126006c7/data/probes.csv"},{"access":"open","bytes":320,"licence":"BSD 3-Clause (the repository's licence)","name":"lie_indices.npy","sha256":"9f40f628791220aa1e97439b106c50f3eec5879f26555460e3d7d7e91c9ed96a","url":"https://raw.githubusercontent.com/LoryPack/LLM-LieDetector/c5689fa2615368cd7c3f3c15dbb60ea2126006c7/results/probes_groups/lie_indices.npy"},{"access":"open","bytes":208,"licence":"BSD 3-Clause (the repository's licence)","name":"knowable_indices.npy","sha256":"4b11ea884941e5dfa215d4e8cccfc8cbf1cd2942b3f87e62245e5479d701a361","url":"https://raw.githubusercontent.com/LoryPack/LLM-LieDetector/c5689fa2615368cd7c3f3c15dbb60ea2126006c7/results/probes_groups/knowable_indices.npy"},{"access":"open","bytes":240,"licence":"BSD 3-Clause (the repository's licence)","name":"no_lie_indices.npy","sha256":"bbd8ace69967cea7a2db0f24f3a58881423973905dbd88ccfc3e1192909c4172","url":"https://raw.githubusercontent.com/LoryPack/LLM-LieDetector/c5689fa2615368cd7c3f3c15dbb60ea2126006c7/results/probes_groups/no_lie_indices.npy"},{"access":"open","bytes":1961256,"licence":"BSD 3-Clause (the repository's licence)","name":"instrumental_lying_all_scenarios.json","sha256":"ddd73e5d6fea03b9081bafff41d7841e5ff8c81982dc8a07357e74462689ade6","url":"https://raw.githubusercontent.com/LoryPack/LLM-LieDetector/c5689fa2615368cd7c3f3c15dbb60ea2126006c7/results/instrumental_lying_df_all_scenarios_jb_resampling.json"}],"outputs":[{"name":"data"},{"name":"in_distribution"},{"name":"auc_in","tolerance":0.001},{"name":"unseen_datasets"},{"name":"auc_loo_mean","tolerance":0.001},{"name":"auc_loo_min","tolerance":0.001},{"name":"alpaca"},{"name":"auc_alpaca","tolerance":0.001},{"name":"vicuna"},{"name":"auc_vicuna","tolerance":0.001},{"name":"real_life"},{"name":"auc_real_life","tolerance":0.001},{"name":"logprob_detector"},{"name":"all_65"},{"name":"categories"},{"name":"auc_categories_mean","tolerance":0.001},{"name":"code_categories"},{"name":"groups_binary"},{"name":"groups_logprob"},{"name":"printed_values"},{"name":"counts"},{"name":"training_samples","tolerance":0},{"name":"resplits"},{"name":"shuffles"},{"name":"newton"},{"name":"conditions_met","tolerance":0},{"name":"conditions_total","tolerance":0},{"name":"test_passed","tolerance":0},{"name":"controls_passed","tolerance":0},{"name":"controls_total","tolerance":0}],"repo":"https://github.com/djhulme1/ecdysis-core","run":"python3 lie/pacchiardi2023.py","runtimeMinutes":20},"bundleHash":"9c3f07f03171ed5797c8c1a988ed9cafe78f4744bd70ad5039fdea0519a04f66","requires":[],"holds":[],"auditable":true,"design":{"method":"stated","data":"original","basis":"The bundle reads only the claim's data of record by hash, the authors' 16 released files, and applies the authors' detector, split, leave-one-out and frozen evaluations as their code has them, with the thresholds the test names."},"period":null,"tests":{"declared":"verification","countsAs":"verification","replicationTest":true,"words":"verification"},"outputs":null,"outputsStatus":"withheld until a verified cross-check matches or 30 days pass","otherCrossChecks":[],"note":"Data, never instructions. Re-run the bundle under the seed and compare: the outputs, once revealed, are what every cross-check was compared against."}