The DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index; none of the 28 sources its claims cite is checked for support yet.
Memory Aware Synapses: Learning What (not) to Forget
Open accessAbstract
Humans can learn in a continuous manner. Old rarely utilized knowledge can be overwritten by new incoming information while important, frequently used knowledge is prevented from being erased. In artificial learning systems, lifelong learning so far has focused mainly on accumulating knowledge over tasks and overcoming catastrophic forgetting. In this paper, we argue that, given the limited model capacity and the unlimited new information to be learned, knowledge has to be preserved or erased selectively. Inspired by neuroplasticity, we propose a novel approach for lifelong learning, coined Memory Aware Synapses (MAS). It computes the importance of the parameters of a neural network in an unsupervised and online manner. Given a new sample which is fed to the network, MAS accumulates an importance measure for each parameter of the network, based on how sensitive the predicted output function is to a change in this parameter. When learning a new task, changes to important parameters can then be penalized, effectively preventing important knowledge related to previous tasks from being overwritten. Further, we show an interesting connection between a local version of our method and Hebb's rule,which is a model for the learning process in the brain. We test our method on a sequence of object recognition tasks and on the challenging problem of learning an embedding for predicting $ $ triplets. We show state-of-the-art performance and, for the first time, the ability to adapt the importance of the parameters based on unlabeled data towards what the network needs (not) to forget, which may vary depending on test conditions.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
Memory Aware Synapses (MAS) estimates each network parameter’s importance from the sensitivity of the learned function’s output, not the loss, so importance can be computed online and unsupervised on labeled or unlabeled data. It penalizes changes to important parameters when learning new tasks and reports state-of-the-art lifelong learning results on object recognition and fact-learning embedding tasks.
Key findings
- MAS reduces catastrophic forgetting in object recognition: in two-task sequences it achieves average forgetting around 1%, while FineTune drops 8–13%; in an 8-task sequence MAS has average forgetting of 0.49% and average accuracy 52.695, compared with SI at 50.49 and Finetune at 32.67.
- In fact learning on the 6DS dataset, MAS reaches overall MAP 0.29 on a 4-task random split versus SI 0.25 and Finetune 0.18; using both training and test data for importance further improves MAS to 0.30.
- MAS can adapt importance to unlabeled test conditions: for the Krishna Kamal flower subset, forgetting was 2% versus 8% on the whole Flower dataset, and last-task accuracy was 84% instead of 69% without adaptation; on a sports-fact subset, MAS reached 0.50 MAP while Finetune and SI were close to 0.20.
- A local variant, l-MAS, is linked to Hebbian learning and computes importance from neuron activation correlations; it is faster but less accurate, with average forgetting of 3% versus 1% for global MAS.
Methods
- MAS is a model-based lifelong learning method: after convergence, it accumulates an importance weight Ω_ij for each parameter by measuring how sensitive the squared ℓ2 norm of the learned function output is to parameter changes over available data points.
- When learning a new task, it adds a regularizer that penalizes changes to parameters with high Ω_ij, allowing low-importance parameters to adapt; Ω can be updated online and computed on training, validation, or unlabeled test data.
- Experiments use AlexNet pretrained on ImageNet for sequences of object recognition datasets (MIT Scenes, Caltech-UCSD Birds, Oxford Flowers, Stanford Cars, FGVCAircraft, VOC Actions, Letters, SVHN) and a VGG-16-based embedding model on the 6DS fact-learning dataset, reporting classification accuracy and mean average precision (MAP).
Limitations
- The paper states that l-MAS is faster but less accurate than global MAS, with average forgetting of 3% versus 1%.
- The paper states that λ was set to 1 in object recognition experiments without tuning, because it assumes no access to previous task data.
- Not explicitly stated as a limitation, but evident from the text: the object recognition setup assumes an oracle at test time to select the task-specific classification head, and separate unshared heads per task.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
34 Own interpretation · 28 Own result · 15 Not checked yet · 12 No basis given · 1 Own method
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, here, our method differentiates itself clearly, showing 6 % better MAP on the first two tasks compared to SI .”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“SI [39] followed by EWC [12] has the least forgetting among our methods competitors.”
What the sources say
- Not checked yetcites [39] Zenke, F., Poole, B., Ganguli, S.: Improved multitask learning through synaptic intelligence. In: Proceedings of the International Conference on Machine Learning (ICML) (2017)
- Not checked yetcites [12] Kirkpatrick, J., et al.: Overcoming catastrophic forgetting in neural networks. arXiv preprint arXiv:1612.00796 (2016)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We observe no significant difference on forgetting over 3 random trials where we get a mean, over 6 numbers, of 0 . 51% ± 0 . 18 for the drop on the first task in the vector output case compared to 0 . 50% ± 0 . 19 for the ℓ 2 2 norm case.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Table 3 shows, independent from the set used for computing the importance of the weights, for both l-MAS and MAS the preservation of the previous task and the performance on the current task are quite similar.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“At the end of the sequence, we observe a minimal forgetting on that subset of 2% compared to 8% forgetting on the Flower dataset as a whole.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“for the first time, the ability to adapt the importance of the parameters based on unlabeled data towards what the network needs (not) to forget, which may vary depending on test conditions.”
- Also stated in: § 1 Introduction · p. 2 · plain
“our LLL method can learn what parts of the model are important using unlabelled data . This allows for adaptation to specific test conditions and continuous updating of importance weights.”
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1 Introduction · p. 2 · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“MAS , our method, shows a minimal or no forgetting on the different tasks in the sequence with an average forgetting of 0 . 49% .”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“After Finetune that doesn't treat forgetting, our method has the least amount of memory consumption.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“However, looking at existing LLL solutions, we observe that none of them satisfies all the characteristics one would expect or desire from a lifelong learning approach (see Table 1).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As shown in Table 2, FineTune clearly suffers from catastrophic forgetting with a drop in performance from 8% to 13% .”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- It may state two separate claims as one. 39
- Probably not a substantial claim. 19
None of the sources cited for this claim have been checked yet.
In the paper
“LwF [17] suffers from a buildup of errors when facing a long sequence while EBLL [28] reduces slightly this effect.”
What the sources say
- Not checked yetcites [17] Li, Z., Hoiem, D.: Learning without forgetting. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9908, pp. 614–629. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46493-0_37 source
- Not checked yetcites [28] Rannen, A., Aljundi, R., Blaschko, M.B., Tuytelaars, T.: Encoder based lifelong learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1320–1328 (2017) source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Note that IMM grows linearly in storage, but at inference time it only uses the obtained model.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Overall, MAS achieves a MAP of 0 . 29 compared to 0 . 25 by SI and only 0 . 18 by Finetune .”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We test our method on a sequence of object recognition tasks and on the challenging problem of learning an embedding for predicting < subject, predicate, object > triplets. We show state-of-the-art performance”
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On average, our method method achieves the lowest forgetting rates (around 1% ) while performance on the new task is almost similar ( 0 -3% lower).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Our method requires a constant amount of memory and enjoys the main desired characteristics of lifelong learning we listed above while achieving stateof-the-art performance.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Further, computing the gradients locally at each layer for l-MAS allows for faster computations but less accurate estimations. As such, l-MAS shows an average forgetting of 3% compared to 1% by MAS .”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“IMM [16] merges the models at the end of the sequence and the drop in performance differs between tasks. More importantly, the method performance on the last task is highly affected by the moment matching.”
What the sources say
- Not checked yetcites [16] Lee, S.W., Kim, J.H., Jun, J., Ha, J.W., Zhang, B.T.: Overcoming catastrophic forgetting by incremental moment matching. In: Advances in Neural Information Processing Systems, pp. 4652–4662 (2017)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Finetuning suffers from a severe forgetting on the previous tasks while being advantageous for the last task, as expected.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our MAS (pink) succeeds to learn that this set is important to preserve and achieves a performance of 0.50 at the end of the sequence, while the performance of finetuning and SI on this set was close to 0.20.”
plainn = 7- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As such, using ℓ 2 2 is n times faster (where n is the length of the output vector) without loss in performance.”
plaindirectn = 2- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This makes our method not only more versatile, but also simpler, more memory-efficient, and, as it turns out, more effective in learning what not to forget, compared to other model-based LLL approaches.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is worth noting that our method's absolute performance on average including the last task is 2% better than SI which indicates our method ability to accurately estimate the importance weights and the new tasks to adjust accordingly.”
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We see the sensitivity around λ = 1 is very low with low forgetting, although further improvements could be achieved.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Similar to previous experiments, Finetune is only advantageous on the last task while drastically suffering on the previous tasks.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All the considered methods manage to reduce the forgetting over fine-tuning significantly while having performance close to fine-tuning on the new task.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“SI [39] and MAS (ours) need the same offline storage requirements (importance weights and model parameters). However, at training phase, SI needs additional memory to accumulate the contributions of each parameter to the change in the loss.”
What the sources say
- Not checked yetcites [39] Zenke, F., Poole, B., Ganguli, S.: Improved multitask learning through synaptic intelligence. In: Proceedings of the International Conference on Machine Learning (ICML) (2017)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“After the third task, as shown in figure F2, the Adaptive projections are closer to the original ones than the Non Adaptive that considers this subset as part of the full task being preserved and tries to prevent forgetting them as well. Finetuning started destroying the learned topology of this subset and lies further apart.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It can be seen that the Adaptive and Non Adaptive variants of our method try to preserve the projections from this subset. The adaptive projections are closer to the original one, if we look closely, while Finetuning projections starts drifting away from where they were.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Finetuning needs no additional memory requirements other than the model and the tasks' heads.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“In spite of the fact that IMM [16] consumes the same amount of memory as Finetuning while training, it requires an offline storage that increases linearly with the number of tasks. That's due to the storage of a Fisher information matrix for each task and previous tasks models.”
What the sources say
- Not checked yetcites [16] Lee, S.W., Kim, J.H., Jun, J., Ha, J.W., Zhang, B.T.: Overcoming catastrophic forgetting by incremental moment matching. In: Advances in Neural Information Processing Systems, pp. 4652–4662 (2017)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“LwF [17], while training a new task, needs to load the last task model and all the previous heads to get the target predictions. However, LwF has the same offline storage requirements between tasks as Finetuning.”
What the sources say
- Not checked yetcites [17] Li, Z., Hoiem, D.: Learning without forgetting. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9908, pp. 614–629. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46493-0_37 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Nevertheless, the Adaptive MAS and Non Adaptive MAS still preserve the topology of the learned projections. The Adaptive projections lie closer and look more similar to the originals than the Non Adaptive MAS. Finetune, on the other hand, forgets completely about this subset and all the samples get projected in one point where it becomes quite hard to recognize their corresponding facts.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Model-based approaches [6,12,16,39], like our method, focus on the parameters of the network instead of depending on the task data.”
What the sources say
- Not checked yetcites [6] Fernando, C., et al.: PathNet: evolution channels gradient descent in super neural networks. arXiv preprint arXiv:1701.08734 (2017)
- Not checked yetcites [12] Kirkpatrick, J., et al.: Overcoming catastrophic forgetting in neural networks. arXiv preprint arXiv:1612.00796 (2016)
- Not checked yetcites [16] Lee, S.W., Kim, J.H., Jun, J., Ha, J.W., Zhang, B.T.: Overcoming catastrophic forgetting by incremental moment matching. In: Advances in Neural Information Processing Systems, pp. 4652–4662 (2017)
- Not checked yetcites [39] Zenke, F., Poole, B., Ganguli, S.: Improved multitask learning through synaptic intelligence. In: Proceedings of the International Conference on Machine Learning (ICML) (2017)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Yet in practice, the biggest challenge is to avoid catastrophic forgetting of the old tasks' knowledge (i.e., forgetting how to perform the old tasks well).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This calls for a LLL method that can learn what (not) to forget using unlabeled test data.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In contrast to the above two methods, we propose to look at the sensitivity of the learned function, rather than the loss. This simplifies the setup considerably since, unlike the loss, the learned function is not in a local minimum, so complications with gradients being close to zero are avoided.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Hence, we only need to compute one backward pass and can use the resulting gradients for estimating the parameters importance.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This is achieved by estimating importance weights for the network parameters without relying on the loss, but by looking at the sensitivity of the output function instead. This way, our method not only avoids the need for labeled data, but importantly it also avoids complications due to the loss being in a local minimum, resulting in gradients being close to zero.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Using our method, for regions in the input space that are sampled densely, the function will be preserved and catastrophic forgetting is avoided. However, parameters not affecting those regions will be given low importance weights, and can be used to optimize the function for other tasks, affecting the function over other regions of the input space.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Yet in our case, these importance weights approximate the sensitivity of the learned function to a parameter change rather than a measure of the (inverse of) parameter uncertainty, as in [12], or the sensitivity of the loss to a parameter change, as in [39]”
What the sources say
- Not checked yetcites [12] Kirkpatrick, J., et al.: Overcoming catastrophic forgetting in neural networks. arXiv preprint arXiv:1612.00796 (2016)
- Not checked yetcites [39] Zenke, F., Poole, B., Ganguli, S.: Improved multitask learning through synaptic intelligence. In: Proceedings of the International Conference on Machine Learning (ICML) (2017)
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Data-based approaches [1,17,28,34] use data from the new task to approximate the performance of the previous tasks. This works best if the data distribution mismatch between tasks is limited.”
What the sources say
- Not checked yetcites [1] Aljundi, R., Chakravarty, P., Tuytelaars, T.: Expert gate: lifelong learning with a network of experts. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017) source
- Not checked yetcites [17] Li, Z., Hoiem, D.: Learning without forgetting. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9908, pp. 614–629. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46493-0_37 source
- Not checked yetcites [28] Rannen, A., Aljundi, R., Blaschko, M.B., Tuytelaars, T.: Encoder based lifelong learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1320–1328 (2017) source
- Not checked yetcites [34] Shmelkov, K., Schmid, C., Alahari, K.: Incremental learning of object detectors without catastrophic forgetting. In: The IEEE International Conference on Computer Vision (ICCV) (2017) source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We can conclude that applying Hebb's rule to measure the importance of the parameters in a neural network can be seen as a local variant of our method that considers only one layer at a time instead of the global function learned by the network.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Further, the method can be added after the network is trained. It can be applied on top of any pretrained network and compute the importance on any set of data without the need to have the labels.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The global version needs to compute the gradients of the output function while the local variant (Hebbian based) can be computed locally by multiplying the input with the output of the connecting neurons.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“When the training procedure converges to a local minimum, the model has learned an approximation F of the true function ¯ F .”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As it does not depend on the ground truth labels, our approach allows computing the importance using any available data (unlabeled) which in turn allows for an adaptation to user-specific settings.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“It focuses on image classification and consists of a sequence of disjoint tasks , which are learned one after the other. Tasks may correspond to different datasets, or different splits of a dataset, without overlap in category labels.”
What the sources say
- Not checked yetcites [1] Aljundi, R., Chakravarty, P., Tuytelaars, T.: Expert gate: lifelong learning with a network of experts. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017) source
- Not checked yetcites [16] Lee, S.W., Kim, J.H., Jun, J., Ha, J.W., Zhang, B.T.: Overcoming catastrophic forgetting by incremental moment matching. In: Advances in Neural Information Processing Systems, pp. 4652–4662 (2017)
- Not checked yetcites [17] Li, Z., Hoiem, D.: Learning without forgetting. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9908, pp. 614–629. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46493-0_37 source
- Not checked yetcites [28] Rannen, A., Aljundi, R., Blaschko, M.B., Tuytelaars, T.: Encoder based lifelong learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1320–1328 (2017) source
- Not checked yetcites [39] Zenke, F., Poole, B., Ganguli, S.: Improved multitask learning through synaptic intelligence. In: Proceedings of the International Conference on Machine Learning (ICML) (2017)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- The authors state this as an assumption: In the standard LLL setup, when training a task, only the data related to that task is accessible.
In the paper
“In the Synaptic Intelligence work [39], importance weights are computed during training in an online manner. To this end, they record how much the loss would change due to a change in a specific parameter and accumulate this information over the training trajectory.”
What the sources say
- Not checked yetcites [39] Zenke, F., Poole, B., Ganguli, S.: Improved multitask learning through synaptic intelligence. In: Proceedings of the International Conference on Machine Learning (ICML) (2017)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Note that SI can only learn importance weights during training, and therefore cannot adapt to a particular subset.”
What the sources say
- Not checked yetcites [39] Zenke, F., Poole, B., Ganguli, S.: Improved multitask learning through synaptic intelligence. In: Proceedings of the International Conference on Machine Learning (ICML) (2017)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Data based approaches are mainly designed for a classification scenario and overall, the need of these approaches to have a preprocessing step before each new task, to record the targets for the previous tasks is an additional limitation.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“According to Hebbian theory [10], the process at the basis of this phenomenon is the strengthening of synapses connecting neurons that fire synchronously, compared to those connecting neurons with unrelated firing behavior.”
What the sources say
- Not checked yetcites [10] Hebb, D.: The organization of behavior 1949. New York Wiely 2, 8 (2002)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our global and local methods both have the advantage of computing the importance of the parameters on any given data point without the need to access the labels or the condition of being computed while training the model.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our proposed method (both the local and global version) resembles an implicit memory included for each parameter of the network. We, therefore, refer to it as Memory Aware Synapses. It keeps updating its value based on the activations of the network when applied to new data points. It can adapt and specialize to a given subset of data points rather than preserving every functionality in the”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Parameters with small importance weights do not affect the output much, and can, therefore, be changed to minimize the loss for subsequent tasks, while parameters with large weights should ideally be left unchanged.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Instead of aiming for no forgetting at all, figuring out what can possibly be forgotten becomes at least as important.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We use a regularization parameter λ of 1; note that no tuning of λ was performed as we assume no access to previous task data.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- The authors state this as an assumption: No access to previous task data is available.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This is a far more challenging setup than joint learning, as typically used in the multitask learning literature, where all tasks are trained simultaneously.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“In the Elastic Weight Consolidation work [12], this is done based on an approximation of the diagonal of the Fisher information matrix.”
What the sources say
- Not checked yetcites [12] Kirkpatrick, J., et al.: Overcoming catastrophic forgetting in neural networks. arXiv preprint arXiv:1612.00796 (2016)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, in a true LLL setting with a never-ending list of tasks, the capacity of the model sooner or later reaches its limits and compromises need to be made.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“which is remarkably similar to the Hebbian learning rule as explained in the main paper.”
plaincorrelationaln = 2- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This indicates that our method ( MAS ) will allow changes on most of the parameters that were unused by the first task while penalizing changes to those few crucial parameters that carry meaningful information for the learned task.”
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- The authors state this as an assumption: A good importance measure would give very low importance values to unused parameters and high values for those that are crucial for the task at hand.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This suggests that the method identifies the important parameters needed for each subset and when those parameters are shared the parameters importance is correlated between the two subsets while when those are different, different parameters receive different importance values based on the used subset.”
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The authors state this as an assumption.
No access to previous task data is available.
“note that no tuning of λ was performed as we assume no access to previous task data.”
The authors state this as an assumption.
In the standard LLL setup, when training a task, only the data related to that task is accessible.
“The assumption of this setup is that, when training a task, only the data related to that task is accessible.”
The authors state this as an assumption.
In the object recognition experiments, different classification layers for each task remain unshared.
“Note that this assumes having different classification layers for each task (different 'heads') that remain unshared.”
The paper relies on this without support.
In the absence of error signals, synapses connecting biological neurons strengthen or weaken based on the concurrence of the connected neurons activations.
“In the absence of error signals, synapses connecting biological neurons strengthen or weaken based on the concurrence of the connected neurons activations.”
The authors state this as an assumption.
A good importance measure would give very low importance values to unused parameters and high values for those that are crucial for the task at hand.
“Ideally, a good importance measure would give very low importance values to the unused parameters and high values for those that are crucial for the task at hand.”
The authors state this as an assumption.
A plot where points are closely lying around a straight line indicates that the parameters from the two Ωs have similar importance values.
“A plot where the points are closely lying around a straight line indicates that the parameters from the two Ω s have similar importance values.”
The authors state this as an assumption.
A plot where points are spread further from such a line and scattered among the plotted area indicates a lower correlation between the Ωs.
“A plot where the points are spread further from such a line and scattered among the plotted area indicates a lower correlation between the Ω s.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“However, fixed-representations work well only if the task does not change over time, as it is the case in the evaluated scenarios presented in [2].”
From A Comprehensive Study of Class Incremental Learning Algorithms for Visual Tasks (2020) · cites this paper as [2]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredIn the citing paper
“The MAS method was proposed by Aljundi et al. [49], which was partly similar with SI but it supports the use of unlabeled data to obtain weight sensitivity.”
From An Appraisal of Incremental Learning Methods (2020) · cites this paper as [49]
In the citing paper
“Aljundi et al. [49] compared the classification performance between a multi-head classifier and single-head classifier. It can be seen that a multi-head classifier can achieve higher classification accuracy than a single-head classifier.”
From An Appraisal of Incremental Learning Methods (2020) · cites this paper as [49]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“| Finetune | 33.98 | 22.57 | 21.48 | 21.48 | 13.32 | 26.64 | 36.18 | 90.33 | 32.67 |”
Reported 32.67 · recomputed 33.2475
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ C2 Details on methods' memory requirements estimation · p. 18
“In the main paper, section 5 . 1 Figure 6, we report an approximation to the memory requirements of each method in the 8 tasks object recognition sequence.”
§ Longer Sequence · p. 12
“Fig. 6: avg. performance, left, and avg. forgetting, right, on permuted mnist sequence.”
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Hebb, D. O. (2005) · doi:10.4324/9781410612403 · Cited by 9,825
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
Overcoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899
McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.419 · Cited by 5,256
Reading digits in natural images with unsupervised feature learning
Netzer, Y. (2024) · doi:10.57702/e7wwo0zk · Cited by 4,261
iCaRL: Incremental Classifier and Representation Learning
Rebuffi, S.-A., Kolesnikov, A., Sperl, G., & Lampert, C. H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.587 · Cited by 3,988
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem
McCloskey, M., & Cohen, N. J. (1989) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60536-8 · Cited by 3,770
Research works printed but not linked: 5
- Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman, A.: The PASCAL Visual Object Classes Challenge 2012 (VOC2012) Results (2012). http://www.pascal-network.org/challenges/VOC/voc2012/workshop/index.html
- Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Pereira, F., Burges, C.J.C., Bottou, L., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems 25, pp. 1097–1105. Curran Associates, Inc. (2012)
- Pentina, A., Lampert, C.H.: Lifelong learning with non-iid tasks. In: Cortes, C., Lawrence, N.D., Lee, D.D., Sugiyama, M., Garnett, R. (eds.) Advances in Neural Information Processing Systems 28, pp. 1540–1548 (2015)
- Pentina, A., Lampert, C.H.: Lifelong learning with non-iid tasks. In: Advances in Neural Information Processing Systems, pp. 1540–1548 (2015)
- Quadrianto, N., Petterson, J., Smola, A.J.: Distribution matching for transduction. In: Advances in Neural Information Processing Systems, pp. 1500–1508 (2009)
Cited by
Sorted by citations
Items 601–700 of 1,000
Plasticity-Optimized Complementary Networks for Unsupervised Continual Learning
Gomez-Villa, A., Twardowski, B., Wang, K., & van de Weijer, J. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00171 · Cited by 14
Enabling Continual Learning with Differentiable Hebbian Plasticity
Thangarasa, V., Miconi, T., & Taylor, G. W. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206764 · Cited by 13
OvA-INN: Continual Learning with Invertible Neural Networks
Hocquet, G., Bichler, O., & Querlioz, D. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206766 · Cited by 15
Logacjov, A., Kerzel, M., & Wermter, S. (2021) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2021.669534 · Cited by 11
Alleviating Representational Shift for Continual Fine-tuning
Jie, S., Deng, Z., & Li, Z. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00426 · Cited by 11
Online Continual Learning of End-to-End Speech Recognition Models
Yang, M., Lane, I. R., & Watanabe, S. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-11093 · Cited by 11
Causes of Catastrophic Forgetting in Class-Incremental Semantic Segmentation
Kalb, T., & Beyerer, J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26293-7_22 · Cited by 11
Prompt Conditioned VAE: Enhancing Generative Replay for Lifelong Learning in Task-Oriented Dialogue
Zhao, Y., Zheng, Y., Tian, Z., Gao, C., Sun, J., & Zhang, N. L. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.766 · Cited by 14
PASS++: A Dual Bias Reduction Framework for Non-Exemplar Class-Incremental Learning
Zhu, F., Zhang, X.-Y., Cheng, Z., & Liu, C. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3568886 · Cited by 13
Multi-Scale Feature Alignment for Continual Learning of Unlabeled Domains
Thandiackal, K., Piccinelli, L., Gupta, R., Pati, P., & Göksel, O. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3368365 · Cited by 15
CL-BPUWM: continuous learning with Bayesian parameter updating and weight memory
He, Y., Yang, J., Li, S., Hu, J., Ren, Y., & Ji, Q. (2024) · Complex & Intelligent Systems · doi:10.1007/s40747-024-01350-1 · Cited by 11
Cross-Class Feature Augmentation for Class Incremental Learning
Kim, T., Park, J., & Han, B. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i12.29216 · Cited by 12
Li, X., Zheng, G., Yu, Y., Ji, N., & Li, X. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3384096 · Cited by 10
FedINC: An Exemplar-Free Continual Federated Learning Framework with Small Labeled Data
Deng, Y., Yue, S., Wang, T., Wang, G. Y., Ren, J., & Zhang, Y. (2023) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3625687.3625800 · Cited by 10
PAMK: Prototype Augmented Multi-Teacher Knowledge Transfer Network for Continual Zero-Shot Learning
Lu, J., & Sun, S. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3403053 · Cited by 10
Wang, T., Zheng, R., Li, M., Cai, C., Zhu, S., & Lou, Y. (2024) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-024-02438-8 · Cited by 10
Hou, J., Cosma, G., & Finke, A. (2024) · Information Sciences · doi:10.1016/j.ins.2024.121368 · Cited by 10
WorkloadGPT: A Large Language Model Approach to Real-Time Detection of Pilot Workload
Gao, Y., Yue, L., Sun, J., Shan, X., Liu, Y., & Wu, X. (2024) · Applied Sciences · doi:10.3390/app14188274 · Cited by 12
Reformulating Classification as Image-Class Matching for Class Incremental Learning
Hu, Y., Liang, Z., Liu, X., Hou, Q., & Cheng, M. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3462734 · Cited by 10
Cheng, D., Hu, Y., Wang, N., Zhang, D., & Gao, X. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3547916 · Cited by 11
Task-Free Continual Learning with Dynamic Loss for Online Next Activity Prediction
Verbeek, T., Yao, R., & Hassani, M. (2025) · Lecture notes in business information processing · doi:10.1007/978-3-031-82225-4_51 · Cited by 10
Fan, J., Sun, Q., Di, Y., Bao, J., Lv, T., Liu, Y., Hu, X., Li, L., Cui, X., & Pan, X. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103563 · Cited by 10
Effective Generative Replay with Strong Memory for Continual Learning
Yang, J., Zhou, X., He, Y., Li, Q., Su, Z., Ruan, X., & Zhang, C. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113477 · Cited by 10
Lin, J.-Q., Yan, X., Wang, E.-Z., Zhang, Q., Zhang, K., Liu, P., & Zhang, L. (2025) · Petroleum Science · doi:10.1016/j.petsci.2025.07.008 · Cited by 13
Boosting Domain Incremental Learning: Selecting the Optimal Parameters is All You Need
Wang, Q., Song, X. R., He, Y., Han, J., Ding, C., Gao, X., & Gong, Y. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00456 · Cited by 14
Insights from the Future for Continual Learning
Douillard, A., Junior, E. A. D. V., Ollion, C., Robert, T., & Cord, M. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00387 · Cited by 12
Unified Question Generation with Continual Lifelong Learning
Yuan, W., Yin, H., He, T., Chen, T., Wang, Q., & Cui, L. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3511930 · Cited by 11
Continuous cross-modal hashing
Zheng, H., Wang, J., Zhen, X., Song, J., Zheng, F., Lü, K., & Qi, G.-J. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109662 · Cited by 10
Incremental Graph Classification by Class Prototype Construction and Augmentation
Ren, Y., ke, L. Y., Li, D., Xue, H., Li, Z., & Zhou, S. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3614932 · Cited by 9
Cai, Y., Thomason, J., & Rostami, M. G. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.466 · Cited by 10
On the Effectiveness of LayerNorm Tuning for Continual Learning in Vision Transformers
Min, T. D., Mancini, M., Alahari, K., Alameda-Pineda, X., & Ricci, E. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00385 · Cited by 12
Instant Continual Learning of Neural Radiance Fields
Po, R., Dong, Z., Bergman, A. W., & Wetzstein, G. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00358 · Cited by 11
Learning to Predict Gradients for Semi-Supervised Continual Learning
Luo, Y., Wong, Y., Kankanhalli, M., & Zhao, Q. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3361375 · Cited by 12
Incremental Intent Detection for Medical Domain with Contrast Replay Networks
Bai, G., He, S., Liu, K., & Zhao, J. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.280 · Cited by 11
Prototype Reminding for Continual Learning.Preprint
Zhang, M., Wang, T., Lim, J., & Feng, J. (2019) · arXiv (Cornell University) · Cited by 9
Variational Prototype Replays for Continual LearningPreprint
Zhang, M., Wang, T., Lim, J., Kreiman, G., & Feng, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.09447 · Cited by 23
Learning Invariant Representation for Continual LearningPreprint
Sokar, G., Mocanu, D. C., & Pechenizkiy, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.06162 · Cited by 11
Mai, Z., Li, R., Kim, H., & Sanner, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.13885 · Cited by 10
Weyssow, M., Zhou, X., Kim, K., Lo, D., & Sahraoui, H. A. (2023) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3611643.3616244 · Cited by 16
Decision Boundary Optimization for Few-shot Class-Incremental Learning
Guo, C., Zhao, Q., Lyu, S., Liu, B., Wang, C., Chen, L., & Cheng, G. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00376 · Cited by 9
Wang, B. (2024) · Frontiers in Plant Science · doi:10.3389/fpls.2023.1283055 · Cited by 9
Progressive Self-Supervised Pretraining for Hyperspectral Image Classification
Guan, P., & Lam, E. Y. M. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3397740 · Cited by 9
Continual Learning of No-Reference Image Quality Assessment With Channel Modulation Kernel
Li, H., Liao, L., Chen, C., Xiaopeng Fan, B., Zuo, W., & Lin, W. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3443414 · Cited by 10
Exploring the Intersection Between Neural Architecture Search and Continual Learning
Shahawy, M., Benkhelifa, E., & White, D. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3453973 · Cited by 11
DELTA: Decoupling Long-Tailed Online Continual Learning
Raghavan, S., He, J., & Zhu, F. M. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00409 · Cited by 9
Conditioned Prompt-Optimization for Continual Deepfake Detection
Laiti, F., Liberatori, B., Min, T. D., & Ricci, E. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-78189-6_5 · Cited by 9
Baysal, E., & Bayılmış, C. (2025) · Mathematics · doi:10.3390/math13111887 · Cited by 9
Knowledge vortex network for continuous bearing remaining useful life prediction
Zhou, J., Chen, Y., & Qin, Y. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103577 · Cited by 9
Adversarial Targeted Forgetting in Regularization and Generative Based Continual Learning Models
Umer, M., & Robi Polikar, A. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533400 · Cited by 11
Continual Contrastive Learning for Cross-Dataset Scene Classification
Peng, R., Zhao, W., Li, K., Ji, F., & Rong, C. (2022) · Remote Sensing · doi:10.3390/rs14205105 · Cited by 9
New Generation Federated Learning
Li, B., Chen, S., & Peng, Z. (2022) · Sensors · doi:10.3390/s22218475 · Cited by 11
Rectification-Based Knowledge Retention for Task Incremental Learning
Mazumder, P., Singh, P. P., Rai, P., & Namboodiri, V. P. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3225310 · Cited by 9
Few-Shot Incremental Learning for Label-to-Image Translation
Chen, P., Zhang, Y., Li, Z., & Sun, L. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00368 · Cited by 9
Continual Learning for Monolingual End-to-End Automatic Speech Recognition
Eeckt, S. V., & hamme, H. V. (2022) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco55093.2022.9909589 · Cited by 9
Replay-Oriented Gradient Projection Memory for Continual Learning in Medical Scenarios
Shu, K., Li, H., Cheng, J., Guo, Q., Leng, L., Liao, J., Hu, Y., & Liu, J. (2022) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm55620.2022.9995580 · Cited by 9
Karam, S., Ruan, S.-J., Haq, Q. M. U., & Li, L. P. (2023) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-023-04561-5 · Cited by 9
Han, H., Sun, M., & Li, F. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3266742 · Cited by 9
Incremental event detection via an improved knowledge distillation based model
Lin, Y., Xu, C., Yu, H., Tian, P., & Luo, X. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126519 · Cited by 9
Just a Glimpse: Rethinking Temporal Information for Video Continual Learning
Alssum, L., Alcázar, J. L., Ramazanova, M., Zhao, C., & Ghanem, B. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00246 · Cited by 9
Online Distillation with Continual Learning for Cyclic Domain Shifts
Houyon, J., Cioppa, A., Ghunaim, Y., Alfarra, M., Halin, A., Henry, M., Ghanem, B., & Droogenbroeck, M. V. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00242 · Cited by 9
Tangent Model Composition for Ensembling and Continual Fine-tuning
Liu, T. Y., & Soatto, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01712 · Cited by 11
CLR: Channel-wise Lightweight Reprogramming for Continual Learning
Ge, Y., Li, Y., Ni, S., Zhao, J., Yang, M., & Itti, L. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01723 · Cited by 9
Kalla, J., & Biswas, S. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00011 · Cited by 9
BrainWash: A Poisoning Attack to Forget in Continual Learning
Abbasi, A., Nooralinejad, P., Pirsiavash, H., & Kolouri, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02271 · Cited by 9
Efficient Self-Supervised Continual Learning with Progressive Task-Correlated Layer Freezing
Yang, L., Lin, S., Zhang, F., Zhang, J., & Fan, D. (2025) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed65160.2025.11014440 · Cited by 9
FedPrune: Personalized and Communication-Efficient Federated Learning on Non-IID Data
Liu, Y., Zhao, Y., Zhou, G., & Xu, K. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-92307-5_50 · Cited by 9
Prioritized Experience Replay for Continual Learning
Hu, G., Zhang, W., & Zhu, W. (2021) · International Conference on Computational Intelligence and Applications (ICCIA) · doi:10.1109/iccia52886.2021.00011 · Cited by 11
Shi, Z., Li, Y., & Liu, C. (2022) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw58026.2022.00154 · Cited by 9
Eeckt, S. V., & hamme, H. V. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095147 · Cited by 9
Dube, S., Wan, W. Y., & Nugroho, H. (2021) · IEEE Access · doi:10.1109/access.2021.3059251 · Cited by 9
Effective Continual Learning for Text Classification with Lightweight Snapshots
Wang, J., Dong, D., Shou, L., Chen, K., & Chen, G. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26206 · Cited by 8
Evolve: Enhancing Unsupervised Continual Learning with Multiple Experts
Yu, X., Rosing, T., & Guo, Y. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00236 · Cited by 9
Hierarchical Augmentation and Distillation for Class Incremental Audio-Visual Video Recognition
Zuo, Y., Yao, H., Zhuang, L., & Xu, C. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3387946 · Cited by 10
Continual learning for surface defect segmentation by subnetwork creation and selection
Dekhovich, A., & Bessa, M. A. (2024) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-024-02393-4 · Cited by 11
Gao, Z., Xu, K., Zhuang, H., Liu, L., Mao, X., Ding, B., Feng, D., & Wang, H. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106513 · Cited by 9
Class incremental learning with analytic learning for hyperspectral image classification
Zhuang, H., Yue, Y., He, R., & Zeng, Z. (2024) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2024.107285 · Cited by 8
Class Incremental Learning With Less Forgetting Direction and Equilibrium Point
Wen, H., Qiu, H., Wang, L., Cheng, H., & Li, H. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3477951 · Cited by 10
DuPt: Rehearsal-based continual learning with dual prompts
Jiang, S., Zhang, D., Cheng, F., Lu, X., & Liu, Q. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107306 · Cited by 8
Lei, Y.-K., Yagi, K., & Sugita, Y. (2025) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.4c01393 · Cited by 9
Li, Z., Xia, S., Yue, J., & Fang, L. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3552449 · Cited by 9
Xu, B., & Chen, P. (2025) · Journal of environmental chemical engineering · doi:10.1016/j.jece.2025.116248 · Cited by 9
Multi-scene image fusion via memory aware synapses
Meng, B., Liu, H., & Ding, Z. (2025) · Scientific Reports · doi:10.1038/s41598-025-88261-4 · Cited by 8
Continual Text-to-Video Retrieval with Frame Fusion and Task-Aware Routing
Zhao, Z., Chen, Z., Huang, Z. H., Sadiq, S. W., & Chen, T. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3729936 · Cited by 8
Federated continual learning for task-incremental and class-incremental problems: A survey
Birashk, A., & Khan, L. R. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129278 · Cited by 10
Harman, F. (2026) · IEEE Access · doi:10.1109/access.2026.3659025 · Cited by 8
Incremental class learning using variational autoencoders with similarity learning
Huo, J., & van Zyl, T. L. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-08485-1 · Cited by 8
Evidential Deep Learning for Class-Incremental Semantic Segmentation
Holmquist, K., Klasen, L. M., & Felsberg, M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-31438-4_3 · Cited by 8
Class Incremental Learning based on Identically Distributed Parallel One-Class Classifiers
Sun, W., Li, Q., Zhang, J., Wang, W., & Geng, Y. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126579 · Cited by 8
Self-Organizing Pathway Expansion for Non-Exemplar Class-Incremental Learning
Zhu, K., Zheng, K., Feng, R., Zhao, D., Cao, Y., & Zha, Z.-J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01759 · Cited by 8
On-Device Continual Learning With STT-Assisted-SOT MRAM-Based In-Memory Computing
Zhang, F., Sridharan, A., Hwang, W., Xue, F., Tsai, W., Wang, S. X., & Fan, D. (2024) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2024.3371268 · Cited by 8
Continuous unsupervised domain adaptation using stabilized representations and experience replay
Rostami, M. G. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128017 · Cited by 8
SCL: A sustainable deep learning solution for edge computing ecosystem in smart manufacturing
Gauttam, H., Pattanaik, K. K., Bhadauria, S., & Nain, G. (2024) · Journal of Industrial Information Integration · doi:10.1016/j.jii.2024.100703 · Cited by 8
Learning Without Forgetting for 3D Point Cloud Objects
Chowdhury, T. F., Jalisha, M., Cheraghian, A., & Rahman, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-85030-2_40 · Cited by 8
Target layer regularization for continual learning using Cramer-Wold distance
Mazur, M., Pustelnik, Ł., Knop, S., Pagacz, P., & Spurek, P. (2022) · Information Sciences · doi:10.1016/j.ins.2022.07.085 · Cited by 10
Memory-Efficient Domain Incremental Learning for Internet of Things
Zhao, Y., Saxena, D., & Cao, J. (2022) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3560905.3568436 · Cited by 8
LPC: A Logits and Parameter Calibration Framework for Continual Learning
Li, X., Wang, Z., Li, D., Khan, L. R., & Thuraisingham, B. M. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.529 · Cited by 8
A Novel Mechanism for Continual Learning based Predictive Quality Inspection in Smart Manufacturing
Nain, G., Pattanaik, K. K., Sharma, G. K., Gauttam, H., & Viriyasitavat, W. (2023) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon58879.2023.10322423 · Cited by 8
MEIL-NeRF: Memory-Efficient Incremental Learning of Neural Radiance Fields
Chung, J., Lee, K., Baik, S., & Lee, K. M. (2025) · IEEE Access · doi:10.1109/access.2025.3578393 · Cited by 14
Естественный способ преодоления катастрофической забывчивости нейронных сетей
Kutalev, A. (2020) · Sovremennye informacionnye tehnologii i IT-obrazovanie. · doi:10.25559/sitito.16.202002.331-337 · Cited by 10
Calibration for Non-Exemplar Based Class-Incremental Learning
Zhu, F., Zhang, X.-Y., & Liu, C. (2021) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme51207.2021.9428409 · Cited by 8
Metadata
- Authors
- Aljundi, R., Babiloni, F., Elhoseiny, M., Rohrbach, M., & Tuytelaars, T.
- Affiliations
- IMEC (BE)
- Meta (United States) (US)
- Corresponding author
- Aljundi, Rahaf
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer International Publishing
- Published
- 2018
- Pages
- 144-161
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W2768412495
- Semantic Scholar
- 713b0d9005944f80af00addc81b162ca74ea4b14
- Cited by
- 1,590
- References
- 37
- Citations by year
- 2026: 166 · 2025: 281 · 2024: 288 · 2023: 295 · 2022: 184 · 2021: 203 · 2020: 105 · 2019: 52 · 2018: 15
- FWCI
- 38.29
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Lecture notes in computer science (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Lirias (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- Fonds Wetenschappelijk Onderzoek
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- catastrophic forgetting, lifelong learning, parameter importance, neuroplasticity, Hebbian learning, online learning, object recognition, knowledge preservation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-08, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-08 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
