What does the evidence support?

Sort hypothetical research scenarios by the evidence they actually provide, then inspect the reasoning.

Teaching model · computed in your browser

Read a claim like a researcher

Practice separating a proposed design, an inspected implementation, and evidence from an actual experiment.

Each scenario is hypothetical. Classify the evidence actually provided, then inspect the explanation and the next evidence needed. A correct answer here is practice feedback, not a scientific or professional certification.

Try this: identify what each scenario directly establishes before deciding whether it supports a broader capability claim.

Practice controls

The default worked example is shown below.

Scenario1 / 6

Reviewed with explanation0 / 6

Correct on first check0Practice feedback, not a certification

A promising architecture

A design note says: “The next version will combine persistent state, a graph, and a planning loop.” No implementation or experiment is attached. What does this support?

Choose the strongest category directly supported by this scenario Proposed design Inspected source or code Reported runtime claim Measured or computed test result Independent replication

These are hypothetical teaching scenarios. Choose a category and check your reasoning to reveal a specific explanation. A title, model name, equation, or moving counter alone cannot establish a scientific capability.

Read all six scenarios and their explanations

A promising architecture

A design note says: “The next version will combine persistent state, a graph, and a planning loop.” No implementation or experiment is attached. What does this support?

Proposed design. The note specifies an intended design. It establishes what someone proposes to build; it does not establish that the system exists or works. Stronger evidence would link the design to inspectable implementation and a clearly defined test.

A function in a repository

You inspect a versioned function that implements s_next = a × s + b × u. You have not executed it. What is directly established?

Inspected source or code. The source documents the expression and implementation at that revision. Execution, integration, and performance remain separate questions. A reproducible test can verify behavior for stated inputs; integration tests can then establish how the function is used.

A changing dashboard

A dashboard shows a rising “intelligence” counter. Its backend, metric definition, and stored observations have not been inspected. How should the displayed capability be described?

Reported runtime claim. The display is observable, but its interpretation is a reported claim. A changing number alone does not validate the capability named beside it. Look for the metric definition, the data path, repeatable inputs, and the records from which the number was calculated.

A complete small test

An experiment publishes its six-node graph, objective, every bipartition, and a script. Re-running the script gives the stated minimum on that graph. What is supported?

Measured or computed test result. This is a reproducible measured result for the stated graph and objective. It does not establish performance on larger graphs or a different MIP definition. Generalization requires additional cases, a defined sampling procedure, appropriate baselines, and clearly stated limitations.

Another team repeats the work

A separate team implements a published algorithm from its specification, repeats the stated experiment, and reports matching results with its own code and environment. What additional evidence is present?

Independent replication. An independent implementation and repeat study reduce reliance on one team’s code and environment. The conclusion still applies to the tested claim and conditions. Inspect methodological differences, uncertainty, failures, and the scope of agreement before extending the conclusion.

A score of one

The unity lab computes 1 / (1 + |1 − 1|) = 1. A student says this proves consciousness. Which category describes what the computation actually establishes?

Measured or computed test result. The computation establishes the value of a defined teaching function at a defined input. It does not validate consciousness, AGI, or a real machine state. To assess a scientific interpretation, define the observable claim and identify evidence that could support or contradict it.

Turn exploration into understanding

Learn the ideas behind this lab.

Follow a worked example, practice on your own, and return to the original project sources.

Progress is kept in this browser. How learning works