After some further consideration I think it's quite clear that the only probability mass function evaluated in the computation of is that of the classically computed ideal distribution, denoted in the main paper.

This leads me to the conclusion that the phrasing of the following excerpt from section IV.C of the Supplemental Information (and especially the part underlined in red) is a bit unfortunate/misleading:

Just because the empirically measured bitstrings are coming from the uniform distribution doesn't mean that is suddenly for all . , as it goes into the calculation of the , is still the probability of sampling bitstring from the classically computed ideal distribution. This is in general not .

The correct reasoning is that the fact that will be (and ) when bitstrings are sampled from the uniform distribution follows from the definitions of expectation and probability mass function:

The definition of expected value is the following sum where is the probability of bitstring being sampled from the classically computed ideal quantum circuit, is the probability of being sampled from the non-ideal empirical distribution, and the sum runs over all possible bitstrings.

When bitstrings are coming from the uniform distribution will always be so can be broken out of the sum: When you sum any probability mass function (of which is one example) over all the possible outcomes you by definition get 1, and thus:

Answer from Björn Smedman on Stack Exchange
🌐
ADS
ui.adsabs.harvard.edu › abs › 2020arXiv200502421B › abstract
Spoofing Linear Cross-Entropy Benchmarking in Shallow Quantum Circuits - ADS
The linear cross-entropy benchmark (Linear XEB) has been used as a test for procedures simulating quantum circuits. Given a quantum circuit $C$ with $n$ inputs and outputs and purported simulator whose output is distributed according to a ...
Videos
December 8, 2021
396
January 15, 2021
748

After some further consideration I think it's quite clear that the only probability mass function evaluated in the computation of is that of the classically computed ideal distribution, denoted in the main paper.

This leads me to the conclusion that the phrasing of the following excerpt from section IV.C of the Supplemental Information (and especially the part underlined in red) is a bit unfortunate/misleading:

Just because the empirically measured bitstrings are coming from the uniform distribution doesn't mean that is suddenly for all . , as it goes into the calculation of the , is still the probability of sampling bitstring from the classically computed ideal distribution. This is in general not .

The correct reasoning is that the fact that will be (and ) when bitstrings are sampled from the uniform distribution follows from the definitions of expectation and probability mass function:

The definition of expected value is the following sum where is the probability of bitstring being sampled from the classically computed ideal quantum circuit, is the probability of being sampled from the non-ideal empirical distribution, and the sum runs over all possible bitstrings.

When bitstrings are coming from the uniform distribution will always be so can be broken out of the sum: When you sum any probability mass function (of which is one example) over all the possible outcomes you by definition get 1, and thus:

Answer from Björn Smedman on Stack Exchange
🌐
Stack Exchange
quantumcomputing.stackexchange.com › questions › 8427 › quantum-supremacy-some-questions-on-cross-entropy-benchmarking
experimental realization - Quantum Supremacy: Some questions on cross-entropy benchmarking - Quantum Computing Stack Exchange

After some further consideration I think it's quite clear that the only probability mass function evaluated in the computation of is that of the classically computed ideal distribution, denoted in the main paper.

This leads me to the conclusion that the phrasing of the following excerpt from section IV.C of the Supplemental Information (and especially the part underlined in red) is a bit unfortunate/misleading:

Just because the empirically measured bitstrings are coming from the uniform distribution doesn't mean that is suddenly for all . , as it goes into the calculation of the , is still the probability of sampling bitstring from the classically computed ideal distribution. This is in general not .

The correct reasoning is that the fact that will be (and ) when bitstrings are sampled from the uniform distribution follows from the definitions of expectation and probability mass function:

The definition of expected value is the following sum where is the probability of bitstring being sampled from the classically computed ideal quantum circuit, is the probability of being sampled from the non-ideal empirical distribution, and the sum runs over all possible bitstrings.

When bitstrings are coming from the uniform distribution will always be so can be broken out of the sum: When you sum any probability mass function (of which is one example) over all the possible outcomes you by definition get 1, and thus:

Answer from Björn Smedman on quantumcomputing.stackexchange.com
🌐
Wikipedia
en.wikipedia.org › wiki › Cross-entropy_benchmarking
Cross-entropy benchmarking - Wikipedia
September 27, 2025 - {\displaystyle \{x_{1},\dots ,x_{k}\}} . The bitstrings are then used to calculate the cross-entropy benchmark fidelity (
🌐
ResearchGate
researchgate.net › figure › Cross-entropy-benchmarking-and-fidelity-a-The-circuit-fidelity-a-as-a-function-of-the_fig4_305780465
Cross-entropy benchmarking and fidelity a, The circuit fidelity α as a... | Download Scientific Diagram
Download scientific diagram | Cross-entropy benchmarking and fidelity a, The circuit fidelity α as a function of the number of qubits. Different colours correspond to different Pauli error rates r2 = rinit = rres = r and r1 = r/10.
🌐
arXiv
arxiv.org › abs › 2005.02421
[2005.02421] Spoofing Linear Cross-Entropy Benchmarking in Shallow Quantum Circuits
May 5, 2020 - The linear cross-entropy benchmark (Linear XEB) has been used as a test for procedures simulating quantum circuits. Given a quantum circuit $C$ with $n$ inputs and outputs and purported simulator whose output is distributed according to a ...
🌐
American Physical Society
link.aps.org › doi › 10.1103 › PRXQuantum.5.010334
Limitations of Linear Cross-Entropy as a Measure for Quantum ...
February 29, 2024 - It has been suggested that such a quantum advantage can be certified with the linear cross-entropy benchmark (XEB). We critically examine this notion. First, we consider a “benign” setting, where an honest implementation of a noisy quantum circuit is assumed, and characterize the conditions under which the XEB approximates the fidelity of quantum dynamics.
Find elsewhere
🌐
arXiv
arxiv.org › abs › 2305.04954
[2305.04954] A sharp phase transition in linear cross-entropy benchmarking
May 8, 2023 - Demonstrations of quantum computational ... linear cross-entropy benchmark (XEB). A key question in the theory of XEB is whether it approximates the fidelity of the quantum state preparation....
🌐
Dagstuhl
drops.dagstuhl.de › entities › document › 10.4230 › LIPIcs.ITCS.2021.30
Spoofing Linear Cross-Entropy Benchmarking in Shallow Quantum Circuits
Given a quantum circuit C with n inputs and outputs and purported simulator whose output is distributed according to a distribution p over {0,1}ⁿ, the linear XEB fidelity of the simulator is ℱ_C(p) = 2ⁿ 𝔼_{x ∼ p} q_C(x) -1, where q_C(x) ...
🌐
Wordpress
gilkalai.wordpress.com › 2022 › 10 › 25 › remarkable-limitations-of-linear-cross-entropy-as-a-measure-for-quantum-advantage-by-xun-gao-marcin-kalinowski-chi-ning-chou-mikhail-d-lukin-boaz-barak-and-soonwon-choi
Remarkable: “Limitations of Linear Cross-Entropy as a Measure for Quantum Advantage,” by Xun Gao, Marcin Kalinowski, Chi-Ning Chou, Mikhail D. Lukin, Boaz Barak, and Soonwon Choi | Combinatorics and more
December 9, 2022 - Thus, the XEB alone has limited utility as a benchmark for quantum advantage. We discuss ways to overcome these limitations. F – The fidelity. If is the ideal state and is the noisy state, then the fidelity F is defined by , XEB – the linear cross entropy estimator for the fidelity
🌐
arXiv
arxiv.org › pdf › 2206.08293 pdf
Linear Cross Entropy Benchmarking with Clifford Circuits
This indicates that the Clifford XEB, and in general linear XEB, only provides · useful information when the noise level is sufficiently small. As a rule of thumb, one can estimate ... ensure that the extracted decay rate from the experiment reflects the gate fidelities. To characterize · large errors, one could either change the twirling distribution µ for faster scrambling (e.g. the one · given in Appendix A gives a theoretically provable mixing rate) or benchmark a subset of the qubits
🌐
ScienceDirect
sciencedirect.com › science › article › pii › S2709472325000012
Generalized cross-entropy benchmarking for random circuits with ergodicity - ScienceDirect
January 16, 2025 - The deviation of ergodicity was formulated as a measure for quantum chip benchmarking, and it was demonstrated that it can be used to estimate the circuit fidelity for global depolarizing noise and weakly correlated noise. For a quadratic postprocessing function, our framework recovered Google's result on estimating the circuit fidelity via linear cross-entropy benchmarking (XEB), and we gave a sufficient condition on the noise model characterizing when such estimation is valid.
🌐
arXiv
ar5iv.labs.arxiv.org › html › 2206.08293
[2206.08293] Linear Cross Entropy Benchmarking with Clifford Circuits
March 11, 2024 - As a rule of thumb, one can estimate the convergence rate of the ideal linear XEB values prior to running linear XEB experiments to ensure that the extracted decay rate from the experiment reflects the gate fidelities. To characterize large errors, one could either change the twirling distribution ... \mu for faster scrambling (e.g. the one given in Appendix A gives a theoretically provable mixing rate) or benchmark a subset of the qubits on the device to lower the error of each cycle.
🌐
arXiv
arxiv.org › abs › 2502.09015
[2502.09015] Generalized Cross-Entropy Benchmarking for Random Circuits with Ergodicity
February 13, 2025 - We formulate the deviation of ergodicity as a measure for quantum chip benchmarking and show that it can be used to estimate the circuit fidelity for global depolarizing noise and weakly correlated noise. For a quadratic post-processing function, our framework recovers Google's result on estimating the circuit fidelity via linear cross-entropy benchmarking (XEB), and we give a sufficient condition on the noise model characterizing when such estimation is valid.
🌐
arXiv
arxiv.org › html › 2502.09015
Generalized Cross-Entropy Benchmarking for Random Circuits with Ergodicity
February 13, 2025 - We formulate the deviation of ergodicity as a measure for quantum chip benchmarking and show that it can be used to estimate the circuit fidelity for global depolarizing noise and weakly correlated noise. For a quadratic post-processing function, our framework recovers Google’s result on estimating the circuit fidelity via linear cross-entropy benchmarking (XEB), and we give a sufficient condition on the noise model characterizing when such estimation is valid.
🌐
EITCA
eitca.org › home › what is the foundational concept behind cross-entropy benchmarking (xeb) and how is it used to measure the fidelity of quantum circuits?
What is the foundational concept behind cross-entropy benchmarking (XEB) and how is it used to measure the fidelity of quantum circuits? - EITCA Academy
June 11, 2024 - The cross-entropy difference thus measures the deviation of the empirical distribution from the theoretical prediction. A smaller cross-entropy difference indicates higher fidelity, meaning the quantum device's output is closer to the expected quantum mechanical behavior.
🌐
Nature
nature.com › nature physics › articles › article
Characterizing quantum supremacy in near-term devices | Nature Physics
April 23, 2018 - Therefore, the circuit fidelity αf is approximately equal to the cross-entropy difference; that is, α ≈ αf. This introduces a fundamentally new way to estimate the fidelity of complex quantum circuits, which we call cross-entropy benchmarking.
🌐
American Physical Society
link.aps.org › doi › 10.1103 › PhysRevA.108.052613
Phys. Rev. A 108, 052613 (2023) - Linear cross-entropy benchmarking ...
November 20, 2023 - To validate this claim, we run numerical simulations for the classes of Clifford circuits we propose with noise and observe exponential decays. When noise levels are low, the decay rates are well correlated with the noise of each cycle assuming a multiplicative error accumulation, i.e., where the fidelities of individual gates multiply.