A Blockchain‐Based Federated Learning Method for Smart Healthcare
Open accessAbstract
The development of artificial intelligence and worldwide epidemic events has promoted the implementation of smart healthcare while bringing issues of data privacy, malicious attack, and service quality. The Medical Internet of Things (MIoT), along with the technologies of federated learning and blockchain, has become a feasible solution for these issues. In this paper, we present a blockchain‐based federated learning method for smart healthcare in which the edge nodes maintain the blockchain to resist a single point of failure and MIoT devices implement the federated learning to make full of the distributed clinical data. In particular, we design an adaptive differential privacy algorithm to protect data privacy and gradient verification‐based consensus protocol to detect poisoning attacks. We compare our method with two similar methods on a real‐world diabetes dataset. Promising experimental results show that our method can achieve high model accuracy in acceptable running time while also showing good performance in reducing the privacy budget consumption and resisting poisoning attacks.
AI snapshot
Written from the paper’s full text.
TL;DR
The paper proposes a blockchain-based federated learning method for smart healthcare that combines adaptive differential privacy with a gradient-verification consensus protocol. On a real-world diabetes dataset, it achieves 82.7% accuracy at privacy budget ε=3 while reducing privacy-budget consumption and limiting poisoning-attack success to under 20% in later training.
Key findings
- With adaptive DP, the method exhausts ε=2 and ε=3 in the 36th and 53rd rounds and reaches 78.5% and 82.7% accuracy, respectively; at ε=3 this is only slightly below original FL (84.5%) and BlockFL (84%).
- At 50 training rounds, running time is 1047 s for original FL, 1702 s for BlockFL, and 1624 s for the proposed method.
- To reach 80%, 82%, and 84% model accuracy, the method reduces privacy-budget consumption by 57%, 96%, and 81%, respectively, compared with a conventional fixed-clipping DP method.
- Under a label-flipping poisoning attack with 30% poisoned MIoT devices, the method limits attack success rate to less than 20% in later training, while original FL and BlockFL are almost always above 50%; four MIoT devices are blacklisted by the end of training.
Methods
- Design: a blockchain-based FL framework where edge nodes maintain the blockchain and MIoT devices train locally; it uses an adaptive differential privacy algorithm that adjusts the gradient clipping threshold based on RMSProp-style prior knowledge, and a gradient-verification consensus protocol based on multi-KRUM and Algorand-like committee selection.
- Data and sample: experiments use the American National Institute of Diabetes and Digestive and Kidney Diseases diabetes dataset with eight medical predictor variables and a target variable, split 70:30 into training and testing; the dataset is shuffled and divided evenly among 20 simulated MIoT devices.
- Model and analysis: a CNN with two 5×5 convolution layers, a fully connected layer, and a softmax output layer (1,663,370 parameters) is trained; results compare accuracy, running time, privacy-budget consumption, and poisoning-attack resistance against BlockFL and original FL.
Limitations
- The paper does not include a dedicated limitations section; it only states future work to continue exploring and advancing the method with public partners.
- Evident from the text: evaluation is limited to one real-world diabetes dataset and a simulation of 20 MIoT devices, with no real-world clinical deployment reported.
- Evident from the text: the consensus security assumes no more than 1/3 of miners are malicious, and the method incurs blockchain-related computation overhead and some accuracy loss from DP noise relative to non-private baselines.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 16 cited sources checked · 0 supported · 0 flagged
- Findingown data
The proposed method shows good performance in resisting poisoning attacks.
“Promising experimental results show that our method can achieve high model accuracy in acceptable running time while also showing good performance in reducing the privacy budget consumption and resisting poisoning attacks.”
Quote in the paperSubstantial claim - Findingown data
The proposed method shows good performance in reducing privacy budget consumption.
“Promising experimental results show that our method can achieve high model accuracy in acceptable running time while also showing good performance in reducing the privacy budget consumption and resisting poisoning attacks.”
Quote in the paperSubstantial claim - Findingown data
When training reaches 50 rounds, the running time of original FL, BlockFL, and the proposed method is 1047 s, 1702 s, and 1624 s, respectively.
“when the training reaches 50 rounds, the running time of original FL, BlockFL, and our method is 1047 s, 1702 s, and 1624 s, respectively.”
Quote in the paperSubstantial claim - Findingreasoning
The running time of BlockFL and the proposed method is greater than that of original FL.
“the running time of BlockFL and our method is greater than that of original FL.”
Quote in the paperSubstantial claim - Findingreasoning
Due to the designed adaptive DP algorithm, the local training phase of the proposed method consumes slightly more time than that of BlockFL.
“due to the designed adaptive DP algorithm, the local training phase of our method consumes slightly more time than that of BlockFL”
Quote in the paperNot a substantial claim
- Findingown data
As training goes on, the value of Ct gradually decreases.
“As the training goes on, the value of Ct gradually decreases.”
Quote in the paperSubstantial claim - Findingreasoning
The attack success rate of original FL and BlockFL is almost always greater than 50%.
“their attack success rate is almost always greater than 50%.”
Quote in the paperSubstantial claim - Findingown data
Four MIoT devices have been put into the blacklist at the end of the training.
“experimental data shows that four MIoT devices have been put into the blacklist at the end of the training”
Quote in the paperSubstantial claim - Findingreasoning
The consensus time of the proposed method is less than that of BlockFL.
“and the consensus time of our method is less than that of BlockFL.”
Quote in the paperSubstantial claim - Findingown data
The consensus time of BlockFL and the proposed method is proportional to the number of devices.
“On the contrary, their consensus time is proportional to the number of devices”
Quote in the paperSubstantial claim - Findingown data
The proposed method limits the attack success rate to less than 20% in the later stage of training.
“our method limits the attack success rate to less than 20% in the later stage of training”
Quote in the paperSubstantial claim - Findingown data
The proposed method consumes much less privacy budget than the conventional method to reach the same model accuracy.
“our method consumes much less privacy budget than the conventional method to reach the same model accuracy.”
Quote in the paperSubstantial claim - Interpretationnone given
The proposed blockchain-based federated learning framework provides governance of the whole training process.
“We propose a blockchain-based FL framework for smart healthcare, which not only builds an accurate collaborative model based on multiple edge devices but also provides governance of the whole training process.”
Quote in the paperNot a substantial claim - Interpretationnone given
The proposed blockchain-based federated learning framework builds an accurate collaborative model based on multiple edge devices.
“We propose a blockchain-based FL framework for smart healthcare, which not only builds an accurate collaborative model based on multiple edge devices but also provides governance of the whole training process.”
Quote in the paperNot a substantial claim - Premisecitation
Adding Gaussian noise on the clipped gradient without explaining how to select the clipping threshold is insufficient.
“Reference [24] added Gaussian noise on the clipped gradient but did not explain how to select the clipping threshold.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [24] Abadi M. Chu A. Goodfellow I. Deep learning with differential privacy Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security October 2016 Vienna, Austria 308 318 source
Not checked in the free run.
- Premisenone given
Vanilla federated learning requires a trustworthy central server to aggregate model parameters uploaded by devices and distribute the global model to all devices.
“However, one of the drawbacks of vanilla FL is that it needs a trustworthy central server to aggregate the model parameters uploaded by devices and distribute the global model to all devices.”
Quote in the paperSubstantial claim - Premisecitation
Adding noise on raw data by local differential privacy severely reduces model accuracy.
“Reference [23] added noise on the raw data by local differential privacy, but it reduced the model accuracy severely.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [23] Qi Y. Hossain M. S. Nie J. Li X. Privacy-preserving blockchain-based federated learning for traffic flow prediction Future Generation Computer Systems 2021 117 328 337 source
Not checked in the free run.
- Premisecitation
Advanced privacy attacks such as model inversion and model extraction have shown that model parameters stored in the blockchain are not enough to protect the privacy of raw clinical data.
“The advanced privacy attacks such as model inversion [19] and model extraction attack [20] have shown that the model parameters stored in the blockchain are not enough to protect the privacy of raw clinical data.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [19] Fredrikson M. Jha S. Ristenpart T. Model inversion attacks that exploit confidence information and basic countermeasures Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security October 2015 Denver, CO, USA 1322 1333 source
Not checked in the free run.
- cites [20] Tramèr F. Zhang F. Juels A. Reiter M. K. Ristenpart T. Stealing machine learning models via prediction apis Proceedings of the 25th {USENIX} Security Symposium ({USENIX} Security 16) August 2016 Austin, TX, USA 601 618
Not checked in the free run.
- Premisecitation
Due to the continuity and gradualness of the convergence process, the historical gradient can usually be used to estimate the current gradient.
“Due to the continuity and gradualness of the convergence process [25], the historical gradient can usually be used to estimate the current gradient.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [25] Fang C. Guo Y. Hu Y. Ma B. Feng L. Yin A. Privacy-preserving and communication-efficient federated learning in Internet of Things Computers & Security 2021 103 102199 source
Not checked in the free run.
- Interpretationreasoning
The proposed adaptive differential privacy algorithm can flexibly adjust the clipping threshold according to the training process to reduce the negative impact of noise on model accuracy.
“we draw on the idea of the RMSProp optimization algorithm and propose an adaptive differential privacy algorithm for MIoT devices, which can flexibly adjust the clipping threshold according to the training process to reduce the negative impact of noise on the model accuracy.”
Quote in the paperSubstantial claim - Interpretationreasoning
If the central server in vanilla federated learning crashes, the federated learning training will stop.
“Once the central server is crashed by attackers, the FL training will stop.”
Quote in the paperSubstantial claim - Interpretationnone given
The proposed adaptive differential privacy algorithm adapts noise according to the training process, balancing privacy and model accuracy.
“we propose adaptive differential privacy (DP) algorithm that adapts noise according to the training process, balancing privacy, and model accuracy.”
Quote in the paperNot a substantial claim- Rests on an assumption: Model parameters stored in the blockchain may still be stolen by attackers to infer the original private clinical data.
- Study design and conductnone given
The probability of a miner being selected as a verifier is proportional to its reputation value.
“as designed by the consensus protocol, the probability of a miner being selected as a verifier is proportional to its reputation value”
Quote in the paperSubstantial claim - Interpretationreasoning
Attackers cannot increase the probability of being selected through a Sybil attack without increasing their own reputation value.
“attackers cannot increase the probability of being selected through Sybil attack without increasing its own reputation value”
Quote in the paperSubstantial claim - Study design and conductreasoning
An MIoT device's gradient must be signed by most verifiers before it is finally accepted.
“we require that an MIoT device's gradient must be signed by most verifiers before it is finally accepted.”
Quote in the paperSubstantial claim - Interpretationnone given
Requiring an MIoT device's gradient to be identified as qualified only when it owns the signatures of most verifiers prevents some malicious verifiers from colluding with some MIoT devices.
“We require that an MIoT device's gradient can be identified as qualified only when it owns the signatures of most verifiers so as to prevent some malicious verifiers from colluding with some MIoT devices.”
Quote in the paperNot a substantial claim - Study design and conductnone given
The scheme uses a differential privacy mechanism to protect data privacy.
“Our scheme uses a differential privacy mechanism to protect data privacy”
Quote in the paperSubstantial claim - Interpretationreasoning
The privacy loss of the method is proportional to the number of MIoT devices and training rounds.
“According to Theorem 1, the privacy loss of our method is proportional to the number of MIoT devices and training rounds.”
Quote in the paperSubstantial claim - Premisereasoning
The tail bound in Theorem 2 can convert moment bounds to an (ε, δ)-differential privacy guarantee.
“Then we can use the tail bound in Theorem 2 to convert the moment bounds to (ε, δ=minλexp(α(λ) − λε))- differential privacy guarantee.”
Quote in the paperSubstantial claim - Interpretationcitation
In the reputation-based consistent hashing protocol, the probability of a party being selected is proportional to its reputation.
“The principle of the above process is similar to that of Algorand [27]: the probability of a party being selected is proportional to its reputation.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [27] Gilad Y. Hemo R. Micali S. Vlachos G. Zeldovich N. Algorand: scaling byzantine agreements for cryptocurrencies Proceedings of the 26th Symposium on Operating Systems Principles October 2017 Shanghai, China 51 68 source
Not checked in the free run.
- Premisecitation
The proposed consensus protocol is improved on Algorand.
“our protocol is improved on Algorand [27].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [27] Gilad Y. Hemo R. Micali S. Vlachos G. Zeldovich N. Algorand: scaling byzantine agreements for cryptocurrencies Proceedings of the 26th Symposium on Operating Systems Principles October 2017 Shanghai, China 51 68 source
Not checked in the free run.
- Interpretationown data
Given an appropriate privacy budget, the proposed method protects data privacy with only a slight accuracy loss.
“But given an appropriate privacy budget, our method protects the data privacy with only a slight accuracy loss.”
Quote in the paperSubstantial claim - Interpretationreasoning
The overall moment accountant is bounded by the sum over training rounds and MIoT devices of the per-device per-round moment accountants.
“Based on Theorem 1, we have(13)αλ≤∑t=1T∑i=1Kαi,tλ”
Quote in the paperSubstantial claim - Premisecitation
The consensus protocol follows Algorand, requiring that the newly generated block can only be identified as valid and broadcasted after it is approved by more than 2/3 of the verifiers.
“The consensus protocol follows Algorand [27], requiring that the newly generated block can only be identified as valid and broadcasted after it is approved by more than 2/3 of the verifiers”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [27] Gilad Y. Hemo R. Micali S. Vlachos G. Zeldovich N. Algorand: scaling byzantine agreements for cryptocurrencies Proceedings of the 26th Symposium on Operating Systems Principles October 2017 Shanghai, China 51 68 source
Not checked in the free run.
- Interpretationreasoning
The proposed consensus protocol has high consensus efficiency.
“In each round of training, only some miners are selected to verify the new block by Byzantine agreement protocol, and the communication overhead among miners is further reduced, so the consensus efficiency is high and the forking probability is extremely low.”
Quote in the paperSubstantial claim - Interpretationreasoning
In the RMSProp algorithm, the cumulative square of the historical gradient can be regarded as prior knowledge of the current gradient.
“Therefore, 𝔼[g2]t−1 in the RMSProp algorithm can be regarded as the prior knowledge of the current gradient.”
Quote in the paperSubstantial claim - Interpretationreasoning
It suffices to compute or bound the overall moments of the method.
“By equation 13, it suffices to compute or bound the overall moments α(λ) of our method.”
Quote in the paperSubstantial claim - Interpretationreasoning
In the proposed consensus protocol, only some miners are selected to verify the new block by Byzantine agreement protocol.
“In each round of training, only some miners are selected to verify the new block by Byzantine agreement protocol, and the communication overhead among miners is further reduced, so the consensus efficiency is high and the forking probability is extremely low.”
Quote in the paperSubstantial claim - Interpretationreasoning
The proposed consensus protocol has extremely low forking probability.
“In each round of training, only some miners are selected to verify the new block by Byzantine agreement protocol, and the communication overhead among miners is further reduced, so the consensus efficiency is high and the forking probability is extremely low.”
Quote in the paperSubstantial claim - Interpretationreasoning
The security of the consensus protocol is equivalent to that of Algorand.
“so its security is equivalent to that of Algorand.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [27] Gilad Y. Hemo R. Micali S. Vlachos G. Zeldovich N. Algorand: scaling byzantine agreements for cryptocurrencies Proceedings of the 26th Symposium on Operating Systems Principles October 2017 Shanghai, China 51 68 source
Not checked in the free run.
- Interpretationreasoning
The proposed consensus protocol integrates gradient verification with the consensus protocol to carry out a consensus process among edge nodes.
“we integrate gradient verification with consensus protocol to carry out a consensus process among the edge nodes.”
Quote in the paperSubstantial claim - Study design and conductcitation
The verification committee executes the multi-KRUM algorithm on gradients in the transaction pool and accepts the top majority of the gradients in each training round.
“The verification committee executes the multi-KRUM algorithm [28] on gradients in the transaction pool and accepts the top majority of the gradients in each training round.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [28] Blanchard P. El Mhamdi E. M. Guerraoui R. Stainer J. Machine learning with adversaries: byzantine tolerant gradient descent Proceedings of the 31st International Conference on Neural Information Processing Systems December 2017 Long Beach, CA, USA 118 128
Not checked in the free run.
- Interpretationreasoning
The MIoT device cannot obtain the global gradient of the current training round before uploading the local gradient.
“But according to the training process in Figure 2, the MIoT device cannot obtain the global gradient of the current training round before uploading the local gradient.”
Quote in the paperSubstantial claim - Interpretationreasoning
The proposed consensus protocol reduces communication overhead among miners.
“In each round of training, only some miners are selected to verify the new block by Byzantine agreement protocol, and the communication overhead among miners is further reduced, so the consensus efficiency is high and the forking probability is extremely low.”
Quote in the paperSubstantial claim - Study design and conductnone given
In each round of training, consistent hashing is used to select different miners to verify the new block.
“In each round of training, we use consistent hashing to select different miners to verify the new block.”
Quote in the paperSubstantial claim - Interpretationreasoning
Because the noise distribution added on the local gradient is the same for all MIoT devices, the computation of the per-device per-round moment accountant is the same for all devices.
“Since the noise distribution ξ ~ N(0, (Ctσ)2I) added on the local gradient is the same for all MIoT devices, the computation of αi,t(λ), 1 ≤ i ≤ K, 1 ≤ t ≤ T is the same for all devices.”
Quote in the paperSubstantial claim - Premisenone given
Original FL and BlockFL lack a mechanism to detect the poisoned gradient.
“Since the original FL and BlockFL lack a mechanism to detect the poisoned gradient”
Quote in the paperSubstantial claim - Interpretationown data
The consensus protocol based on gradient verification can effectively resist a certain proportion of poisoning attack.
“indicating that the consensus protocol based on gradient verification we design can effectively resist a certain proportion of poisoning attack.”
Quote in the paperSubstantial claim - Interpretationown data
Experimental results on a real-world diabetes dataset show that the proposed method can achieve similar accuracy to original FL in acceptable running time.
“The experimental results on a real-world diabetes dataset show that our method can achieve similar accuracy to the original FL in acceptable running time.”
Quote in the paperSubstantial claim - Interpretationreasoning
The proposed method can withstand poisoning attacks.
“and withstand poisoning attacks.”
Quote in the paperSubstantial claim - Interpretationnone given
The proposed method can reduce privacy budget consumption.
“We also illustrate its ability to reduce the privacy budget consumption”
Quote in the paperSubstantial claim
- May combine two claims. 26
- Classified as probably not a substantial claim. 8
May combine two claims.
Findingown dataThe proposed method achieves high model accuracy in acceptable running time.
“Promising experimental results show that our method can achieve high model accuracy in acceptable running time while also showing good performance in reducing the privacy budget consumption and resisting poisoning attacks.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningOriginal FL and BlockFL achieve higher model accuracy than the proposed method.
“Original FL and BlockFL achieve higher model accuracy than our method”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataWhen the privacy budget ε=3, the proposed method achieves 82.7% accuracy, which is only slightly lower than 84.5% of original FL and 84% of BlockFL.
“when the privacy budget ε=3, our method achieves 82.7% accuracy, which is only slightly lower than 84.5% of original FL and 84% of BlockFL.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe larger the privacy budget, the higher the model accuracy but the lower the level of privacy preservation simultaneously.
“It can be seen that the larger the privacy budget, the higher the model accuracy but the lower the level of privacy preservation simultaneously.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe method exhausts the privacy budget ε=2 and ε=3 in the 36th and 53rd rounds and achieves model accuracy of 78.5% and 82.7%, respectively.
“Our method exhausts the privacy budget ε=2 and ε=3 in the 36th and 53rd rounds and achieves model accuracy of 78.5% and 82.7%, respectively.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe local training time of BlockFL and the proposed method does not increase with the number of devices.
“but their local training time does not increase with the number of devices.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataDue to the limit of privacy budget ε=3, the proposed method converges in 53 rounds, but original FL and BlockFL cannot converge even within 70 rounds.
“due to the limit of privacy budget ε=3, our method converges in 53 rounds, but the other two methods cannot converge even within 70 rounds.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
FindingreasoningIn the first 10 rounds, Ct keeps unchanged because it is fixed as 3 in the initial training stage.
“in the first 10 rounds, Ct keeps unchanged, which is because we fix it as 3 in the initial training stage according to equation (6).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataWhen the model accuracy is 80%, 82%, and 84%, the proposed method reduces the privacy budget by 57%, 96%, and 81%, respectively, compared with the conventional method.
“when the model accuracy is 80%, 82%, and 84%, our method reduces the privacy budget by 57%, 96%, and 81%, respectively, compared with the conventional method.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningThe curves of the two methods almost overlap at the beginning, but the increase of the privacy budget of the proposed method gradually decreases in the later stage of training, while the privacy budget of the conventional method still increases linearly.
“the curves of the two methods almost overlap at the beginning, but the increase of the privacy budget of our method gradually decreases in the later stage of training, while the privacy budget of the conventional method still increases linearly.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningDifferential privacy technology needs less computation overhead than Shamir secret sharing and threshold Paillier encryption, making it more suitable for MIoT devices with limited resources.
“In contrast, differential privacy technology needs less computation overhead, which is more suitable for MIoT devices with limited resources.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationShamir secret sharing and threshold Paillier encryption both consume large computation overhead.
“References [18, 21] used Shamir secret sharing and threshold Paillier encryption to protect local gradients, respectively, but both consume large computation overhead.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [18] Shayan M. Fung C. Yoon C. J. M. Beschastnikh I. Biscotti: a ledger for private and secure peer-to-peer machine learning 2018 https://arxiv.org/abs/1811.09904
Not checked in the free run.
- cites [21] Weng J. Weng J. Zhang J. Li M. Zhang Y. Luo W. Deepchain: auditable and privacy-preserving deep learning with blockchain-based incentive IEEE Transactions on Dependable and Secure Computing 2019 10.1109/tdsc.2019.2952332 source
Not checked in the free run.
Classified as probably not a substantial claim. May combine two claims.
InterpretationreasoningAdding noise to a dataset can hide private information but at the same time lowers data utility.
“From the above definitions, we can see that the private information in a dataset can be hidden by adding noise, but at the same time, the noise will lower the data utility.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningBlockchain can replace the central server to decentralize the coordination process in federated learning, thereby resisting single points of failure and illegal tampering attacks.
“blockchain can replace the central server to decentralize the coordination process in FL, thus resisting single points of failure and illegal tampering attacks.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
PremisecitationFederated learning allows multiple devices to train machine learning models collaboratively without sharing their raw data.
“Federated learning (FL) [1], as a distributed machine learning framework, can allow multiple devices to train machine learning models collaboratively without sharing their raw data”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [1] McMahan B. Moore E. Ramage D. Hampson S. Arcas B. A. y. Communication-efficient learning of deep networks from decentralized data Proceedings of the 20 th International Conference on Artificial Intelligence and Statistics (AISTATS) 2017 April 2017 Fort Lauderdale, FL, USA 1273 1282
Not checked in the free run.
May combine two claims.
Interpretationnone givenThe value of the clipping threshold is important to the federated learning model: too large a value adds excessive noise and too small a value over clips the gradient, both causing serious accuracy loss.
“The value of the threshold is important to the FL model: too large a value will add excessive noise and too small a value will over clip the gradient, both of which will cause serious accuracy loss.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenThe proposed consensus protocol based on gradient verification encourages reliable MIoT devices and edge nodes to contribute their data and computing power to federated learning.
“We design an efficient consensus protocol based on gradient verification, which encourages reliable MIoT devices and edge nodes to contribute their data and computing power to federated learning.”
Quote in the paperNot a substantial claim- Rests on an assumption: Edge devices have no incentive to contribute dataset and computing power to federated learning.
May combine two claims.
InterpretationreasoningAttackers cannot launch targeted attacks on specific verifiers because the output of consistent hashing cannot be predicted by attackers in advance.
“The output of consistent hashing cannot be predicted by attackers in advance, so attackers cannot launch targeted attacks on specific verifiers.”
Quote in the paperNot a substantial claim- Rests on an assumption: The output of consistent hashing cannot be predicted by attackers in advance.
Probably not a substantial claim: may not pass S4 (based). May combine two claims.
Study design and conductnone givenIn each training round, the reputation value of the MIoT device whose local gradient is identified as qualified and the verifier who returns the correct verification result both increase by 1; otherwise their reputation value decreases by 1.
“in each round of training, the reputation value of the MIoT device whose local gradient is identified as qualified and the verifier who returns the correct verification result will both increase by 1; otherwise, their reputation value will decrease by 1.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe consensus protocol in the blockchain involves time-consuming operations such as block generation, verification, and broadcast, so blockchain-based FL methods achieve security attributes such as auditability, reliability, and resistance to a single point of failure at the cost of some computation overhead.
“This is because the consensus protocol in the blockchain involves time-consuming operations such as block generation, verification, and broadcast. Therefore, blockchain-based FL methods (i.e., BlockFL and our method) achieve a series of security attributes such as auditability, reliability, and resistance to a single point of failure at the cost of some computation overhead”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Study design and conductnone givenWhen the reputation value decreases to zero, the entity is put into the blacklist and prohibited from participating in the consensus.
“When the reputation value decreases to zero, the entity (e.g., MIoT device or edge node) is put into the blacklist and prohibited from participating in the consensus.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductcitationA block is determined valid and broadcasted to arrive at consensus only when more than 2/3 of the verifiers agree on it; otherwise an empty block is created.
“Only when more than 2/3 of the verifiers agree on the block, the block is determined to be valid and broadcasted to arrive at a consensus in the blockchain through the popular gossip protocol [29]. Otherwise, an empty block is created.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [29] Buchman E. Tendermint: byzantine fault tolerance in the age of blockchains 2016 Guelph, Canada University of Guelph Ph.D. thesis
Not checked in the free run.
May combine two claims.
InterpretationreasoningThe prior knowledge E[g2]0=0 in the first training round results in C1=0, which cannot be used for gradient clipping.
“Note that the prior knowledge 𝔼g˜20=0 in the first training round will result in C1=β𝔼g˜20=0, which cannot be used for gradient clipping.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe higher model accuracy of original FL and BlockFL than the proposed method is because the proposed method adds DP noise on the gradient while the other two methods preserve the raw gradient.
“this is because our method adds DP noise on the gradient while the other two methods preserve the raw gradient.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningBecause the adversary cannot obtain the state of the block until it is generated, they cannot predict the output of the consistent hashing and launch targeted attacks.
“Since the adversary cannot obtain the state of the block until it is generated, they cannot predict the output of the consistent hashing and launch targeted attacks.”
Quote in the paperSubstantial claim- Rests on an assumption: The adversary cannot obtain the state of the block until it is generated.
Classified as probably not a substantial claim.
PremisecitationThe privacy accountant proposed by Abadi et al. is used to compute the privacy loss.
“In this paper, we use the privacy accountant proposed by Abadi et al. [24] to compute the privacy loss”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [24] Abadi M. Chu A. Goodfellow I. Deep learning with differential privacy Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security October 2016 Vienna, Austria 308 318 source
Not checked in the free run.
May combine two claims.
InterpretationreasoningAs the value of E[g2]t−1 decreases as the model converges, the local clipping threshold Ct will also decrease, making the differential privacy noise less and contributing to model convergence in the later training stage.
“Since the value of 𝔼g˜2t−1 in equation (6) decreases as the model converges, the local clipping threshold Ct will also decrease, making the DP noise ξ ~ N(0, (Ctσ)2I) in equation (7) less, which contributes to the convergence of the model in the later training stage.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIn the execution of DP-based deep learning methods, the value range of integer λ is usually 0 ≤ λ ≤ 100.
“Note that, in the execution of DP-based deep learning methods [24], the value range of integer λ is usually 0 ≤ λ ≤ 100.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [24] Abadi M. Chu A. Goodfellow I. Deep learning with differential privacy Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security October 2016 Vienna, Austria 308 318 source
Not checked in the free run.
May combine two claims.
InterpretationreasoningEach edge node identifies and removes malicious gradients uploaded by its associated MIoT devices so as to only aggregate qualified gradients to generate the global model and achieve reliable federated learning.
“Each edge node identifies and removes malicious gradients uploaded by its associated MIoT devices so as to only aggregate qualified gradients to generate the global model and achieve reliable FL.”
Quote in the paperNot a substantial claim- Rests on an assumption: Clinical data of some edge devices may be poisoned to mislead the federated learning process.
- Rests on an assumption: Clinical data collected by MIoT devices may be of low quality and even poisoned by adversaries, and local gradients trained on this kind of data will deviate from the global convergence trend.
May combine two claims.
Interpretationown dataThe proposed method uses the same fixed clipping threshold as the conventional method due to insufficient prior knowledge at the beginning but adopts the adaptive DP algorithm in the latter to reduce the consumption of the privacy budget.
“This proves that our method uses the same fixed clipping threshold as the conventional method due to insufficient prior knowledge at the beginning but adopts the adaptive DP algorithm in the latter to reduce the consumption of the privacy budget.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe proposed method uses a more efficient consistent hashing protocol and gradient verification method than BlockFL's PoS consensus.
“while our method uses a more efficient consistent hashing protocol and gradient verification method.”
Quote in the paperSubstantial claim
The paper relies on this without support.
Model parameters stored in the blockchain may still be stolen by attackers to infer the original private clinical data.
“(1) the model parameters stored in the blockchain may still be stolen by attackers to infer the original private clinical data”
The paper relies on this without support.
Clinical data of some edge devices may be poisoned to mislead the federated learning process.
“(2) clinical data of some edge devices may be poisoned to mislead the FL process”
The paper relies on this without support.
Edge devices have no incentive to contribute dataset and computing power to federated learning.
“(3) edge devices have no incentive to contribute dataset and computing power to FL.”
The authors state this as an assumption.
At any point, no more than one third of the miners are malicious.
“we assume that, at any point, no more than 1/3 of the miners are malicious.”
The paper relies on this without support.
Clinical data collected by MIoT devices may be of low quality and even poisoned by adversaries, and local gradients trained on this kind of data will deviate from the global convergence trend.
“the clinical data they collect may be of low quality and even be poisoned by adversaries, and then the local gradient trained on this kind of data will deviate from the global convergence trend.”
The paper relies on this without support.
The adversary cannot obtain the state of the block until it is generated.
“Since the adversary cannot obtain the state of the block until it is generated”
The authors state this as an assumption.
In each training round, the transaction pool contains R gradients, of which f are Byzantine.
“Assume that R is the total number of gradients in the transaction pool and f is the number of Byzantine gradients.”
The paper relies on this without support.
The output of consistent hashing cannot be predicted by attackers in advance.
“The output of consistent hashing cannot be predicted by attackers in advance”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Chang, Fang, and Sun proposed an FL-chain system with adaptive differential privacy that adjusts noise on the gradient to balance privacy and accuracy in a MIoT environment, with a gradient verification-based consensus protocol preventing malicious attacks and single point of failure.
“Chang, Fang, and Sun [42] proposed an FL-chain system with an adaptive differential privacy algorithm. Technically, the system adjusts the amount of noise by adding on the gradient to achieve the balance between privacy and accuracy in a MIoT environment. The key strength of this FL-chain system is the gradient verification-based consensus protocol which is implemented to prevent malicious attacks”
From A Review of Privacy Enhancement Methods for Federated Learning in Healthcare Systems (2023) · cites this paper as [42]
All four FL-chain systems [42,43,44,45] from this review adopted additional privacy enhancement methods to improve privacy protection.
“All of the four FL-chain systems [42,43,44,45] from this review adopted additional privacy enhancement methods to improve privacy protection.”
From A Review of Privacy Enhancement Methods for Federated Learning in Healthcare Systems (2023) · cites this paper as [42]
The consensus process in the FL-chain systems [42,43,44,45] requires significant computational resources.
“Besides the integration of the additional privacy enhancement methods, the consensus process in the FL-chain systems [42,43,44,45] requires significant computational resources.”
From A Review of Privacy Enhancement Methods for Federated Learning in Healthcare Systems (2023) · cites this paper as [42]
Four FL-chain healthcare applications in this review demonstrate that blockchain technology is relevant to FL.
“Four FL-chain healthcare applications [42,43,44,45] in this review prove that the blockchain technology is relevant to FL.”
From A Review of Privacy Enhancement Methods for Federated Learning in Healthcare Systems (2023) · cites this paper as [42]
The existing work in this review presented approaches including adding gradient [42], extra elements [43], hashed EHR address [44], and additional rules [45].
“The existing work in this review presented the approaches including adding gradient [42], extra elements [43], hashed EHR address [44], and additional rules [45].”
From A Review of Privacy Enhancement Methods for Federated Learning in Healthcare Systems (2023) · cites this paper as [42]
Combining blockchain and Federated Learning ensures security of medical data and an efficient model.
“Thus the medical data through the blockchain and Federated Learning security is ensured, and an efficient model can be assured [232].”
From Federated learning-based AI approaches in smart healthcare: Concepts, taxonomies, challenges and open issues (2023) · cites this paper as [232]
Cites
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578 · see citing works
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2014) · Foundations and Trends® in Theoretical Computer Science · doi:10.1561/0400000042 · Cited by 5,557 · see citing works
Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures
Fredrikson, M., Jha, S., & Ristenpart, T. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813677 · Cited by 2,961 · see citing works
Federated Learning for Healthcare Informatics
Xu, J., Glicksberg, B. S., Su, C., Walker, P., Bian, J., & Wang, F. (2021) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-020-00082-4 · Cited by 1,542 · cited 1× · see citing works
“Brisimi et al. [10] predicted hospitalizations for patients with heart diseases by solving distributed sparse Support Vector Machine problems using FL. Xu et al. [11] gave a review for FL methods and pointed out the implications and potentials of FL in healthcare particularly.”
Algorand: Scaling Byzantine Agreements for Cryptocurrencies
Gilad, Y., Hemo, R., Micali, S., Vlachos, G., & Zeldovich, N. (2017) · Proceedings of the 26th Symposium on Operating Systems Principles · doi:10.1145/3132747.3132757 · Cited by 1,499 · see citing works
Blockchain and Federated Learning for Privacy-Preserved Data Sharing in Industrial IoT
Lu, Y., Huang, X., Dai, Y., Maharjan, S., & Zhang, Y. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2942190 · Cited by 1,245 · see citing works
Federated learning of predictive models from federated Electronic Health Records
Brisimi, T. S., Chen, R., Mela, T., Olshevsky, A., Paschalidis, I. C., & Shi, W. (2018) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2018.01.007 · Cited by 997 · cited 1× · see citing works
“Brisimi et al. [10] predicted hospitalizations for patients with heart diseases by solving distributed sparse Support Vector Machine problems using FL. Xu et al. [11] gave a review for FL methods and pointed out the implications and potentials of FL in healthcare particularly.”
Blockchained On-Device Federated Learning
Kim, H., Park, J., Bennis, M., & Kim, S.-L. (2020) · IEEE Communications Letters · doi:10.1109/lcomm.2019.2921755 · Cited by 887 · see citing works
Privacy-Preserving Blockchain-Based Federated Learning for IoT Devices
Zhao, Y., Zhao, J., Jiang, L., Tan, R., Niyato, D., Li, Z., Lyu, L., & Liu, Y. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3017377 · Cited by 613 · see citing works
DeepChain: Auditable and Privacy-Preserving Deep Learning with Blockchain-based Incentive
Weng, J., Weng, J., Zhang, J., Li, M., Zhang, Y., & Luo, W. (2019) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2019.2952332 · Cited by 610 · cited 1× · see citing works
“References [18, 21] used Shamir secret sharing and threshold Paillier encryption to protect local gradients, respectively, but both consume large computation overhead.”
MethodCollaborative Federated Learning for Healthcare: Multi-Modal COVID-19 Diagnosis at the Edge
Qayyum, A., Ahmad, K., Ahsan, M. A., Al-Fuqaha, A., & Qadir, J. (2022) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2022.3206407 · Cited by 345 · see citing works
Privacy-preserving blockchain-based federated learning for traffic flow prediction
Qi, Y., Hossain, M. S., Nie, J., & Li, X. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2020.12.003 · Cited by 339 · cited 1× · see citing works
“Reference [23] added noise on the raw data by local differential privacy, but it reduced the model accuracy severely.”
BackgroundRahman, M. A., Hossain, M. S., Islam, M. S., Alrajeh, N. A., & Muhammad, G. (2020) · IEEE Access · doi:10.1109/access.2020.3037474 · Cited by 312 · see citing works
A Secure Federated Learning Framework for 5G Networks
Liu, Y., Peng, J., Kang, J., Iliyasu, A. M., Niyato, D., & El-Latif, A. A. A. (2020) · IEEE Wireless Communications · doi:10.1109/mwc.01.1900525 · Cited by 290 · see citing works
GANobfuscator: Mitigating Information Leakage Under GAN via Differential Privacy
Xu, C., Ren, J., Zhang, D., Zhang, Y., Qin, Z., & Ren, K. (2019) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2897874 · Cited by 207 · see citing works
Sedik, A., Iliyasu, A. M., El-Rahiem, B. A., Samea, M. E. A., Abdel-Raheem, A., Hammad, M. A., Peng, J., El-Samie, F. E. A., & El‐Latif, A. A. A. (2020) · Viruses · doi:10.3390/v12070769 · Cited by 203 · see citing works
Son, Y., Kim, H., Kim, E., Choi, S., & Lee, S. (2010) · Healthcare Informatics Research · doi:10.4258/hir.2010.16.4.253 · Cited by 184 · see citing works
Prediction of hospitalization due to heart diseases by supervised learning methods
Dai, W., Brisimi, T. S., Adams, W. G., Mela, T., Saligrama, V., & Paschalidis, I. C. (2014) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2014.10.002 · Cited by 143 · see citing works
Zhang, L., Shen, B., Barnawi, A., Xi, S., Kumar, N., & Wu, Y. (2021) · Information Systems Frontiers · doi:10.1007/s10796-021-10144-6 · Cited by 112 · see citing works
Połap, D., Srivastava, G., & Yu, K. (2021) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2021.102748 · Cited by 106 · see citing works
Privacy-preserving and communication-efficient federated learning in Internet of Things
Fang, C., Guo, Y., Hu, Y., Ma, B., Feng, L., & Yin, A. (2021) · Computers & Security · doi:10.1016/j.cose.2021.102199 · Cited by 93 · see citing works
Passerat-Palmbach, J., Farnan, T., McCoy, M., Harris, J. D., Manion, S. T., Flannery, H. L., & Gleim, B. (2020) · 2020 IEEE International Conference on Blockchain (Blockchain) · doi:10.1109/blockchain50366.2020.00080 · Cited by 84 · see citing works
Biscotti: A Ledger for Private and Secure Peer-to-Peer Machine Learning
Shayan, M., Fung, C., Yoon, C. J. M., & Beschastnikh, I. (2018) · arXiv · doi:10.48550/arxiv.1811.09904 · Cited by 61 · see citing works
Blockchain-Federated-Learning and Deep Learning Models for COVID-19 Detection Using CT Imaging
Kumar, R., Khan, A. A., Kumar, J., Zakria, Golilarz, N. A., Zhang, S., Ting, Y., Zheng, C., & Wang, W. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3076767 · Cited by 57 · see citing works
Privacy-Preserving Blockchain-Based Federated Learning for IoT DevicesPreprint
Zhao, Y., Zhao, J., Jiang, L., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.10893 · Cited by 54 · see citing works
Blockchain-Based Federated Learning in Medicine
El-Rifai, O., Biotteau, M., Boissezon, X. D., Megdiche, I., Ravat, F., & Teste, O. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59137-3_20 · Cited by 40 · see citing works
Patient-specific COVID-19 resource utilization prediction using fusion AI model
Tariq, A., Celi, L. A., Newsome, J. M., Purkayastha, S., Bhatia, N. K., Trivedi, H., Gichoya, J. W., & Banerjee, I. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00461-0 · Cited by 36 · see citing works
Collaborative Federated Learning For Healthcare: Multi-Modal COVID-19 Diagnosis at the EdgePreprint
Qayyum, A., Ahmad, K., Ahsan, M. A., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.07511 · Cited by 3 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- McMahanB. MooreE. RamageD. HampsonS. andArcasB. A. y. Communication-efficient learning of deep networks from decentralized data Proceedings of the 20 th International Conference on Artificial Intelligence and Statistics (AISTATS) 2017 April 2017 Fort Lauderdale FL USA 1273–1282.
- TramèrF. ZhangF. JuelsA. ReiterM. K. andRistenpartT. Stealing machine learning models via prediction apis Proceedings of the 25th {USENIX} Security Symposium ({USENIX} Security 16) August 2016 Austin TX USA 601–618.
- BlanchardP. El MhamdiE. M. GuerraouiR. andStainerJ. Machine learning with adversaries: byzantine tolerant gradient descent Proceedings of the 31st International Conference on Neural Information Processing Systems December 2017 Long Beach CA USA 118–128.
- BuchmanE. Tendermint: byzantine fault tolerance in the age of blockchains 2016 University of Guelph Guelph Canada Ph.D. thesis.
Cited by
Sorted by citations
Rahman, A., Hossain, M. S., Muhammad, G., Kundu, D., Debnath, T., Rahman, M., Khan, M. S. I., Tiwari, P., & Band, S. S. (2023) · Cluster Computing · doi:10.1007/s10586-022-03658-4 · Cited by 399 · see citing works
Federated learning for secure IoMT-applications in smart healthcare systems: A comprehensive review
Rani, S., Kataria, A., Kumar, S., & Tiwari, P. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110658 · Cited by 228 · see citing works
Myrzashova, R., Alsamhi, S. H., Shvetsov, A. V., Hawbani, A., & Wei, X. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3263598 · Cited by 178 · see citing works
A Review of Privacy Enhancement Methods for Federated Learning in Healthcare Systems
Gu, X., Sabrina, F., Fan, Z., & Sohail, S. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20156539 · Cited by 139 · see citing works
Ong, J. C. L., Seng, B. J. J., Law, J. Z. F., Low, L. L., Kwa, A. L. H., Giacomini, K. M., & Ting, D. S. W. (2024) · Cell Reports Medicine · doi:10.1016/j.xcrm.2023.101356 · Cited by 111 · see citing works
A blockchain-based federated learning mechanism for privacy preservation of healthcare IoT data
Moulahi, W., Jdey, I., Moulahi, T., Alawida, M., & Alabdulatif, A. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107630 · Cited by 103 · see citing works
Rajendran, S., Pan, W., Sabuncu, M. R., Chen, Y., Zhou, J., & Wang, F. (2024) · Patterns · doi:10.1016/j.patter.2023.100913 · Cited by 47 · see citing works
- Authors
- Chang, Y., Fang, C., & Sun, W.
- Affiliations
- Zhengzhou University (CN)
- Corresponding author
- Chang, Yuxia
- Venue
- Computational Intelligence and Neuroscience
- Publisher
- Wiley
- Published
- 2021-01
- Volume
- 2021
- Issue
- 1
- Pages
- 4376418-4376418
- ISSN
- 1687-5265 (ISSN-L)
- 1687-5273
- PMC
- PMC8635913
- OpenAlex
- W3216394207
- Cited by
- 119
- References
- 28
- Citations by year
- 2026: 16 · 2025: 37 · 2024: 32 · 2023: 24 · 2022: 10
- FWCI
- 5.83
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Computational Intelligence and Neuroscience (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Science and Technology Project of Henan Province (162102310304)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Information Systems › Blockchain Technology Applications and Security
- Physical Sciences › Computer Science › Information Systems › Internet of Things and AI
- Keywords
- blockchain, federated learning, smart healthcare, Internet of Medical Things, data privacy, differential privacy, poisoning attacks, consensus algorithms, edge nodes, diabetes prediction
- MeSH terms
- Blockchain, Artificial Intelligence, Delivery of Health Care, Computer Security, Privacy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-09.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-09.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review