The DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index; none of the 28 sources its claims cite is checked for support yet.
Memory Aware Synapses: Learning What (not) to Forget
Open accessAbstract
Humans can learn in a continuous manner. Old rarely utilized knowledge can be overwritten by new incoming information while important, frequently used knowledge is prevented from being erased. In artificial learning systems, lifelong learning so far has focused mainly on accumulating knowledge over tasks and overcoming catastrophic forgetting. In this paper, we argue that, given the limited model capacity and the unlimited new information to be learned, knowledge has to be preserved or erased selectively. Inspired by neuroplasticity, we propose a novel approach for lifelong learning, coined Memory Aware Synapses (MAS). It computes the importance of the parameters of a neural network in an unsupervised and online manner. Given a new sample which is fed to the network, MAS accumulates an importance measure for each parameter of the network, based on how sensitive the predicted output function is to a change in this parameter. When learning a new task, changes to important parameters can then be penalized, effectively preventing important knowledge related to previous tasks from being overwritten. Further, we show an interesting connection between a local version of our method and Hebb's rule,which is a model for the learning process in the brain. We test our method on a sequence of object recognition tasks and on the challenging problem of learning an embedding for predicting $ $ triplets. We show state-of-the-art performance and, for the first time, the ability to adapt the importance of the parameters based on unlabeled data towards what the network needs (not) to forget, which may vary depending on test conditions.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
Memory Aware Synapses (MAS) estimates each network parameter’s importance from the sensitivity of the learned function’s output, not the loss, so importance can be computed online and unsupervised on labeled or unlabeled data. It penalizes changes to important parameters when learning new tasks and reports state-of-the-art lifelong learning results on object recognition and fact-learning embedding tasks.
Key findings
- MAS reduces catastrophic forgetting in object recognition: in two-task sequences it achieves average forgetting around 1%, while FineTune drops 8–13%; in an 8-task sequence MAS has average forgetting of 0.49% and average accuracy 52.695, compared with SI at 50.49 and Finetune at 32.67.
- In fact learning on the 6DS dataset, MAS reaches overall MAP 0.29 on a 4-task random split versus SI 0.25 and Finetune 0.18; using both training and test data for importance further improves MAS to 0.30.
- MAS can adapt importance to unlabeled test conditions: for the Krishna Kamal flower subset, forgetting was 2% versus 8% on the whole Flower dataset, and last-task accuracy was 84% instead of 69% without adaptation; on a sports-fact subset, MAS reached 0.50 MAP while Finetune and SI were close to 0.20.
- A local variant, l-MAS, is linked to Hebbian learning and computes importance from neuron activation correlations; it is faster but less accurate, with average forgetting of 3% versus 1% for global MAS.
Methods
- MAS is a model-based lifelong learning method: after convergence, it accumulates an importance weight Ω_ij for each parameter by measuring how sensitive the squared ℓ2 norm of the learned function output is to parameter changes over available data points.
- When learning a new task, it adds a regularizer that penalizes changes to parameters with high Ω_ij, allowing low-importance parameters to adapt; Ω can be updated online and computed on training, validation, or unlabeled test data.
- Experiments use AlexNet pretrained on ImageNet for sequences of object recognition datasets (MIT Scenes, Caltech-UCSD Birds, Oxford Flowers, Stanford Cars, FGVCAircraft, VOC Actions, Letters, SVHN) and a VGG-16-based embedding model on the 6DS fact-learning dataset, reporting classification accuracy and mean average precision (MAP).
Limitations
- The paper states that l-MAS is faster but less accurate than global MAS, with average forgetting of 3% versus 1%.
- The paper states that λ was set to 1 in object recognition experiments without tuning, because it assumes no access to previous task data.
- Not explicitly stated as a limitation, but evident from the text: the object recognition setup assumes an oracle at test time to select the task-specific classification head, and separate unshared heads per task.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
34 Own interpretation · 28 Own result · 15 Not checked yet · 12 No basis given · 1 Own method
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, here, our method differentiates itself clearly, showing 6 % better MAP on the first two tasks compared to SI .”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“SI [39] followed by EWC [12] has the least forgetting among our methods competitors.”
What the sources say
- Not checked yetcites [39] Zenke, F., Poole, B., Ganguli, S.: Improved multitask learning through synaptic intelligence. In: Proceedings of the International Conference on Machine Learning (ICML) (2017)
- Not checked yetcites [12] Kirkpatrick, J., et al.: Overcoming catastrophic forgetting in neural networks. arXiv preprint arXiv:1612.00796 (2016)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We observe no significant difference on forgetting over 3 random trials where we get a mean, over 6 numbers, of 0 . 51% ± 0 . 18 for the drop on the first task in the vector output case compared to 0 . 50% ± 0 . 19 for the ℓ 2 2 norm case.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Table 3 shows, independent from the set used for computing the importance of the weights, for both l-MAS and MAS the preservation of the previous task and the performance on the current task are quite similar.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“At the end of the sequence, we observe a minimal forgetting on that subset of 2% compared to 8% forgetting on the Flower dataset as a whole.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“for the first time, the ability to adapt the importance of the parameters based on unlabeled data towards what the network needs (not) to forget, which may vary depending on test conditions.”
- Also stated in: § 1 Introduction · p. 2 · plain
“our LLL method can learn what parts of the model are important using unlabelled data . This allows for adaptation to specific test conditions and continuous updating of importance weights.”
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1 Introduction · p. 2 · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“MAS , our method, shows a minimal or no forgetting on the different tasks in the sequence with an average forgetting of 0 . 49% .”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“After Finetune that doesn't treat forgetting, our method has the least amount of memory consumption.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“However, looking at existing LLL solutions, we observe that none of them satisfies all the characteristics one would expect or desire from a lifelong learning approach (see Table 1).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As shown in Table 2, FineTune clearly suffers from catastrophic forgetting with a drop in performance from 8% to 13% .”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- It may state two separate claims as one. 39
- Probably not a substantial claim. 19
None of the sources cited for this claim have been checked yet.
In the paper
“LwF [17] suffers from a buildup of errors when facing a long sequence while EBLL [28] reduces slightly this effect.”
What the sources say
- Not checked yetcites [17] Li, Z., Hoiem, D.: Learning without forgetting. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9908, pp. 614–629. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46493-0_37 source
- Not checked yetcites [28] Rannen, A., Aljundi, R., Blaschko, M.B., Tuytelaars, T.: Encoder based lifelong learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1320–1328 (2017) source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Note that IMM grows linearly in storage, but at inference time it only uses the obtained model.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Overall, MAS achieves a MAP of 0 . 29 compared to 0 . 25 by SI and only 0 . 18 by Finetune .”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We test our method on a sequence of object recognition tasks and on the challenging problem of learning an embedding for predicting < subject, predicate, object > triplets. We show state-of-the-art performance”
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On average, our method method achieves the lowest forgetting rates (around 1% ) while performance on the new task is almost similar ( 0 -3% lower).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Our method requires a constant amount of memory and enjoys the main desired characteristics of lifelong learning we listed above while achieving stateof-the-art performance.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Further, computing the gradients locally at each layer for l-MAS allows for faster computations but less accurate estimations. As such, l-MAS shows an average forgetting of 3% compared to 1% by MAS .”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“IMM [16] merges the models at the end of the sequence and the drop in performance differs between tasks. More importantly, the method performance on the last task is highly affected by the moment matching.”
What the sources say
- Not checked yetcites [16] Lee, S.W., Kim, J.H., Jun, J., Ha, J.W., Zhang, B.T.: Overcoming catastrophic forgetting by incremental moment matching. In: Advances in Neural Information Processing Systems, pp. 4652–4662 (2017)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Finetuning suffers from a severe forgetting on the previous tasks while being advantageous for the last task, as expected.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our MAS (pink) succeeds to learn that this set is important to preserve and achieves a performance of 0.50 at the end of the sequence, while the performance of finetuning and SI on this set was close to 0.20.”
plainn = 7- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As such, using ℓ 2 2 is n times faster (where n is the length of the output vector) without loss in performance.”
plaindirectn = 2- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This makes our method not only more versatile, but also simpler, more memory-efficient, and, as it turns out, more effective in learning what not to forget, compared to other model-based LLL approaches.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is worth noting that our method's absolute performance on average including the last task is 2% better than SI which indicates our method ability to accurately estimate the importance weights and the new tasks to adjust accordingly.”
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We see the sensitivity around λ = 1 is very low with low forgetting, although further improvements could be achieved.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Similar to previous experiments, Finetune is only advantageous on the last task while drastically suffering on the previous tasks.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All the considered methods manage to reduce the forgetting over fine-tuning significantly while having performance close to fine-tuning on the new task.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“SI [39] and MAS (ours) need the same offline storage requirements (importance weights and model parameters). However, at training phase, SI needs additional memory to accumulate the contributions of each parameter to the change in the loss.”
What the sources say
- Not checked yetcites [39] Zenke, F., Poole, B., Ganguli, S.: Improved multitask learning through synaptic intelligence. In: Proceedings of the International Conference on Machine Learning (ICML) (2017)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“After the third task, as shown in figure F2, the Adaptive projections are closer to the original ones than the Non Adaptive that considers this subset as part of the full task being preserved and tries to prevent forgetting them as well. Finetuning started destroying the learned topology of this subset and lies further apart.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It can be seen that the Adaptive and Non Adaptive variants of our method try to preserve the projections from this subset. The adaptive projections are closer to the original one, if we look closely, while Finetuning projections starts drifting away from where they were.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Finetuning needs no additional memory requirements other than the model and the tasks' heads.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“In spite of the fact that IMM [16] consumes the same amount of memory as Finetuning while training, it requires an offline storage that increases linearly with the number of tasks. That's due to the storage of a Fisher information matrix for each task and previous tasks models.”
What the sources say
- Not checked yetcites [16] Lee, S.W., Kim, J.H., Jun, J., Ha, J.W., Zhang, B.T.: Overcoming catastrophic forgetting by incremental moment matching. In: Advances in Neural Information Processing Systems, pp. 4652–4662 (2017)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“LwF [17], while training a new task, needs to load the last task model and all the previous heads to get the target predictions. However, LwF has the same offline storage requirements between tasks as Finetuning.”
What the sources say
- Not checked yetcites [17] Li, Z., Hoiem, D.: Learning without forgetting. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9908, pp. 614–629. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46493-0_37 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Nevertheless, the Adaptive MAS and Non Adaptive MAS still preserve the topology of the learned projections. The Adaptive projections lie closer and look more similar to the originals than the Non Adaptive MAS. Finetune, on the other hand, forgets completely about this subset and all the samples get projected in one point where it becomes quite hard to recognize their corresponding facts.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Model-based approaches [6,12,16,39], like our method, focus on the parameters of the network instead of depending on the task data.”
What the sources say
- Not checked yetcites [6] Fernando, C., et al.: PathNet: evolution channels gradient descent in super neural networks. arXiv preprint arXiv:1701.08734 (2017)
- Not checked yetcites [12] Kirkpatrick, J., et al.: Overcoming catastrophic forgetting in neural networks. arXiv preprint arXiv:1612.00796 (2016)
- Not checked yetcites [16] Lee, S.W., Kim, J.H., Jun, J., Ha, J.W., Zhang, B.T.: Overcoming catastrophic forgetting by incremental moment matching. In: Advances in Neural Information Processing Systems, pp. 4652–4662 (2017)
- Not checked yetcites [39] Zenke, F., Poole, B., Ganguli, S.: Improved multitask learning through synaptic intelligence. In: Proceedings of the International Conference on Machine Learning (ICML) (2017)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Yet in practice, the biggest challenge is to avoid catastrophic forgetting of the old tasks' knowledge (i.e., forgetting how to perform the old tasks well).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This calls for a LLL method that can learn what (not) to forget using unlabeled test data.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In contrast to the above two methods, we propose to look at the sensitivity of the learned function, rather than the loss. This simplifies the setup considerably since, unlike the loss, the learned function is not in a local minimum, so complications with gradients being close to zero are avoided.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Hence, we only need to compute one backward pass and can use the resulting gradients for estimating the parameters importance.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This is achieved by estimating importance weights for the network parameters without relying on the loss, but by looking at the sensitivity of the output function instead. This way, our method not only avoids the need for labeled data, but importantly it also avoids complications due to the loss being in a local minimum, resulting in gradients being close to zero.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Using our method, for regions in the input space that are sampled densely, the function will be preserved and catastrophic forgetting is avoided. However, parameters not affecting those regions will be given low importance weights, and can be used to optimize the function for other tasks, affecting the function over other regions of the input space.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Yet in our case, these importance weights approximate the sensitivity of the learned function to a parameter change rather than a measure of the (inverse of) parameter uncertainty, as in [12], or the sensitivity of the loss to a parameter change, as in [39]”
What the sources say
- Not checked yetcites [12] Kirkpatrick, J., et al.: Overcoming catastrophic forgetting in neural networks. arXiv preprint arXiv:1612.00796 (2016)
- Not checked yetcites [39] Zenke, F., Poole, B., Ganguli, S.: Improved multitask learning through synaptic intelligence. In: Proceedings of the International Conference on Machine Learning (ICML) (2017)
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Data-based approaches [1,17,28,34] use data from the new task to approximate the performance of the previous tasks. This works best if the data distribution mismatch between tasks is limited.”
What the sources say
- Not checked yetcites [1] Aljundi, R., Chakravarty, P., Tuytelaars, T.: Expert gate: lifelong learning with a network of experts. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017) source
- Not checked yetcites [17] Li, Z., Hoiem, D.: Learning without forgetting. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9908, pp. 614–629. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46493-0_37 source
- Not checked yetcites [28] Rannen, A., Aljundi, R., Blaschko, M.B., Tuytelaars, T.: Encoder based lifelong learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1320–1328 (2017) source
- Not checked yetcites [34] Shmelkov, K., Schmid, C., Alahari, K.: Incremental learning of object detectors without catastrophic forgetting. In: The IEEE International Conference on Computer Vision (ICCV) (2017) source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We can conclude that applying Hebb's rule to measure the importance of the parameters in a neural network can be seen as a local variant of our method that considers only one layer at a time instead of the global function learned by the network.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Further, the method can be added after the network is trained. It can be applied on top of any pretrained network and compute the importance on any set of data without the need to have the labels.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The global version needs to compute the gradients of the output function while the local variant (Hebbian based) can be computed locally by multiplying the input with the output of the connecting neurons.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“When the training procedure converges to a local minimum, the model has learned an approximation F of the true function ¯ F .”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As it does not depend on the ground truth labels, our approach allows computing the importance using any available data (unlabeled) which in turn allows for an adaptation to user-specific settings.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“It focuses on image classification and consists of a sequence of disjoint tasks , which are learned one after the other. Tasks may correspond to different datasets, or different splits of a dataset, without overlap in category labels.”
What the sources say
- Not checked yetcites [1] Aljundi, R., Chakravarty, P., Tuytelaars, T.: Expert gate: lifelong learning with a network of experts. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017) source
- Not checked yetcites [16] Lee, S.W., Kim, J.H., Jun, J., Ha, J.W., Zhang, B.T.: Overcoming catastrophic forgetting by incremental moment matching. In: Advances in Neural Information Processing Systems, pp. 4652–4662 (2017)
- Not checked yetcites [17] Li, Z., Hoiem, D.: Learning without forgetting. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9908, pp. 614–629. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46493-0_37 source
- Not checked yetcites [28] Rannen, A., Aljundi, R., Blaschko, M.B., Tuytelaars, T.: Encoder based lifelong learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1320–1328 (2017) source
- Not checked yetcites [39] Zenke, F., Poole, B., Ganguli, S.: Improved multitask learning through synaptic intelligence. In: Proceedings of the International Conference on Machine Learning (ICML) (2017)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- The authors state this as an assumption: In the standard LLL setup, when training a task, only the data related to that task is accessible.
In the paper
“In the Synaptic Intelligence work [39], importance weights are computed during training in an online manner. To this end, they record how much the loss would change due to a change in a specific parameter and accumulate this information over the training trajectory.”
What the sources say
- Not checked yetcites [39] Zenke, F., Poole, B., Ganguli, S.: Improved multitask learning through synaptic intelligence. In: Proceedings of the International Conference on Machine Learning (ICML) (2017)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Note that SI can only learn importance weights during training, and therefore cannot adapt to a particular subset.”
What the sources say
- Not checked yetcites [39] Zenke, F., Poole, B., Ganguli, S.: Improved multitask learning through synaptic intelligence. In: Proceedings of the International Conference on Machine Learning (ICML) (2017)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Data based approaches are mainly designed for a classification scenario and overall, the need of these approaches to have a preprocessing step before each new task, to record the targets for the previous tasks is an additional limitation.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“According to Hebbian theory [10], the process at the basis of this phenomenon is the strengthening of synapses connecting neurons that fire synchronously, compared to those connecting neurons with unrelated firing behavior.”
What the sources say
- Not checked yetcites [10] Hebb, D.: The organization of behavior 1949. New York Wiely 2, 8 (2002)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our global and local methods both have the advantage of computing the importance of the parameters on any given data point without the need to access the labels or the condition of being computed while training the model.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our proposed method (both the local and global version) resembles an implicit memory included for each parameter of the network. We, therefore, refer to it as Memory Aware Synapses. It keeps updating its value based on the activations of the network when applied to new data points. It can adapt and specialize to a given subset of data points rather than preserving every functionality in the”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Parameters with small importance weights do not affect the output much, and can, therefore, be changed to minimize the loss for subsequent tasks, while parameters with large weights should ideally be left unchanged.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Instead of aiming for no forgetting at all, figuring out what can possibly be forgotten becomes at least as important.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We use a regularization parameter λ of 1; note that no tuning of λ was performed as we assume no access to previous task data.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- The authors state this as an assumption: No access to previous task data is available.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This is a far more challenging setup than joint learning, as typically used in the multitask learning literature, where all tasks are trained simultaneously.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“In the Elastic Weight Consolidation work [12], this is done based on an approximation of the diagonal of the Fisher information matrix.”
What the sources say
- Not checked yetcites [12] Kirkpatrick, J., et al.: Overcoming catastrophic forgetting in neural networks. arXiv preprint arXiv:1612.00796 (2016)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, in a true LLL setting with a never-ending list of tasks, the capacity of the model sooner or later reaches its limits and compromises need to be made.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“which is remarkably similar to the Hebbian learning rule as explained in the main paper.”
plaincorrelationaln = 2- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This indicates that our method ( MAS ) will allow changes on most of the parameters that were unused by the first task while penalizing changes to those few crucial parameters that carry meaningful information for the learned task.”
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- The authors state this as an assumption: A good importance measure would give very low importance values to unused parameters and high values for those that are crucial for the task at hand.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This suggests that the method identifies the important parameters needed for each subset and when those parameters are shared the parameters importance is correlated between the two subsets while when those are different, different parameters receive different importance values based on the used subset.”
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The authors state this as an assumption.
No access to previous task data is available.
“note that no tuning of λ was performed as we assume no access to previous task data.”
The authors state this as an assumption.
In the standard LLL setup, when training a task, only the data related to that task is accessible.
“The assumption of this setup is that, when training a task, only the data related to that task is accessible.”
The authors state this as an assumption.
In the object recognition experiments, different classification layers for each task remain unshared.
“Note that this assumes having different classification layers for each task (different 'heads') that remain unshared.”
The paper relies on this without support.
In the absence of error signals, synapses connecting biological neurons strengthen or weaken based on the concurrence of the connected neurons activations.
“In the absence of error signals, synapses connecting biological neurons strengthen or weaken based on the concurrence of the connected neurons activations.”
The authors state this as an assumption.
A good importance measure would give very low importance values to unused parameters and high values for those that are crucial for the task at hand.
“Ideally, a good importance measure would give very low importance values to the unused parameters and high values for those that are crucial for the task at hand.”
The authors state this as an assumption.
A plot where points are closely lying around a straight line indicates that the parameters from the two Ωs have similar importance values.
“A plot where the points are closely lying around a straight line indicates that the parameters from the two Ω s have similar importance values.”
The authors state this as an assumption.
A plot where points are spread further from such a line and scattered among the plotted area indicates a lower correlation between the Ωs.
“A plot where the points are spread further from such a line and scattered among the plotted area indicates a lower correlation between the Ω s.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“However, fixed-representations work well only if the task does not change over time, as it is the case in the evaluated scenarios presented in [2].”
From A Comprehensive Study of Class Incremental Learning Algorithms for Visual Tasks (2020) · cites this paper as [2]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredIn the citing paper
“The MAS method was proposed by Aljundi et al. [49], which was partly similar with SI but it supports the use of unlabeled data to obtain weight sensitivity.”
From An Appraisal of Incremental Learning Methods (2020) · cites this paper as [49]
In the citing paper
“Aljundi et al. [49] compared the classification performance between a multi-head classifier and single-head classifier. It can be seen that a multi-head classifier can achieve higher classification accuracy than a single-head classifier.”
From An Appraisal of Incremental Learning Methods (2020) · cites this paper as [49]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“| Finetune | 33.98 | 22.57 | 21.48 | 21.48 | 13.32 | 26.64 | 36.18 | 90.33 | 32.67 |”
Reported 32.67 · recomputed 33.2475
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ C2 Details on methods' memory requirements estimation · p. 18
“In the main paper, section 5 . 1 Figure 6, we report an approximation to the memory requirements of each method in the 8 tasks object recognition sequence.”
§ Longer Sequence · p. 12
“Fig. 6: avg. performance, left, and avg. forgetting, right, on permuted mnist sequence.”
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Hebb, D. O. (2005) · doi:10.4324/9781410612403 · Cited by 9,825
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
Overcoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899
McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.419 · Cited by 5,256
Reading digits in natural images with unsupervised feature learning
Netzer, Y. (2024) · doi:10.57702/e7wwo0zk · Cited by 4,261
iCaRL: Incremental Classifier and Representation Learning
Rebuffi, S.-A., Kolesnikov, A., Sperl, G., & Lampert, C. H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.587 · Cited by 3,988
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem
McCloskey, M., & Cohen, N. J. (1989) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60536-8 · Cited by 3,770
Research works printed but not linked: 5
- Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman, A.: The PASCAL Visual Object Classes Challenge 2012 (VOC2012) Results (2012). http://www.pascal-network.org/challenges/VOC/voc2012/workshop/index.html
- Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Pereira, F., Burges, C.J.C., Bottou, L., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems 25, pp. 1097–1105. Curran Associates, Inc. (2012)
- Pentina, A., Lampert, C.H.: Lifelong learning with non-iid tasks. In: Cortes, C., Lawrence, N.D., Lee, D.D., Sugiyama, M., Garnett, R. (eds.) Advances in Neural Information Processing Systems 28, pp. 1540–1548 (2015)
- Pentina, A., Lampert, C.H.: Lifelong learning with non-iid tasks. In: Advances in Neural Information Processing Systems, pp. 1540–1548 (2015)
- Quadrianto, N., Petterson, J., Smola, A.J.: Distribution matching for transduction. In: Advances in Neural Information Processing Systems, pp. 1500–1508 (2009)
Cited by
Sorted by citations
Items 701–800 of 1,000
Domain-Lifelong Learning for Dialogue State Tracking via Knowledge Preservation Networks
Liu, Q., Cao, P., Liu, C., Chen, J., Cai, X., Yang, F., He, S., Liu, K., & Zhao, J. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.176 · Cited by 8
Latent Coreset Sampling based Data-Free Continual Learning
Wang, Z., Li, D., & Li, P. (2022) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3511808.3557375 · Cited by 8
Self-Supervised Learning Aided Class-Incremental Lifelong LearningPreprint
Zhang, S., Shen, G., Huang, J., & Deng, Z.-H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.05882 · Cited by 14
On the importance of cross-task features for class-incremental learningPreprint
Soutif--Cormerais, A., Masana, M., van de Weijer, J., & Twardowski, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.11930 · Cited by 11
Continual variational dropout: a view of auxiliary local variables in continual learning
Hai, N. L., Nguyen, T. T. H., Van, L. N., Nguyen, T. H., & Than, K. Q. (2023) · Machine Learning · doi:10.1007/s10994-023-06487-7 · Cited by 7
Versatile Incremental Learning: Towards Class and Domain-Agnostic Incremental Learning
Park, M.-Y., Lee, J.-H., & Park, G.-M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72751-1_16 · Cited by 7
Dong, Q., Zeng, P., He, Y., Wan, G., & Dong, X. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3487484 · Cited by 7
Yuan, Q., Guan, S.-U., Luo, T., Man, K. L., & Lim, E. G. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129362 · Cited by 7
Zhou, S., Wang, H., Wu, Q., Meng, F., Xu, L., Wei, Z., & Li, H. (2025) · Displays · doi:10.1016/j.displa.2025.102992 · Cited by 7
Zhang, T., Kang Li, B., Gu, S., & Heng, P. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103543 · Cited by 7
Toward Deep Semi-Supervised Continual Learning: A Unified Survey for Scalable and Adaptive AI
Jalal, M. E., & Elmaghraby, A. S. (2025) · IEEE Access · doi:10.1109/access.2025.3556569 · Cited by 8
SCRIPT: A Scalable Continual Reinforcement Learning Framework for Autonomous Penetration Testing
Zhou, S., Liu, J., Lu, Y., Yang, J., Zhang, Y., Lin, B., Zhong, X., & Hu, S. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127827 · Cited by 10
Synthetic Data is an Elegant GIFT for Continual Vision-Language Models
Bin, W., Shi, W., Wang, J., & Ye, M. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00268 · Cited by 10
TaskDrop: A competitive baseline for continual learning of sentiment classification
Mei, J.-P., Zhen, Y., Zhou, Q., & Yan, R. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.08.033 · Cited by 7
Kim, Y., & Shin, J. (2023) · IEEE Access · doi:10.1109/access.2023.3258626 · Cited by 7
Self-Supervised Interactive Image Segmentation
Shi, Q.-X., Li, Y., Di, H., & Wu, E. (2024) · IEEE transactions on circuits and systems for video technology (Print) · doi:10.1109/tcsvt.2023.3295062 · Cited by 11
Multi-Centroid Task Descriptor for Dynamic Class Incremental Inference
Cai, T., Zhang, Z., Tan, X., Qu, Y., Jiang, G., Wang, C., & Xie, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00705 · Cited by 7
Confusion Mixup Regularized Multimodal Fusion Network for Continual Egocentric Activity Recognition
Wang, H., Zhou, S., Wu, Q., Li, H., Meng, F., Xu, L., & Qiu, H. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00382 · Cited by 7
Preparing the Future for Continual Semantic Segmentation
Lin, Z., Wang, Z., & Zhang, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01094 · Cited by 7
A Survey: Navigating the Landscape of Incremental Learning Techniques and Trends
Li, Y., Wu, W., Luo, X., Zheng, M., Zhang, Y., & Peng, B. (2023) · International Conference on Intelligent Systems and Knowledge Engineering (ISKE) · doi:10.1109/iske60036.2023.10481497 · Cited by 7
Efficient Statistical Sampling Adaptation for Exemplar-Free Class Incremental Learning
Cheng, D., Zhao, Y., Wang, N., Li, G., Zhang, D., & Gao, X. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3421587 · Cited by 8
An Experimental Survey of Incremental Transfer Learning for Multicenter Collaboration
Huang, Y., Bert, C., Gomaa, A., Fietkau, R., Maier, A., & Putz, F. (2024) · IEEE Access · doi:10.1109/access.2024.3431885 · Cited by 10
RCL: Reliable Continual Learning for Unified Failure Detection
Zhu, F., Cheng, Z., Zhang, X.-Y., Liu, C., & Zhang, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01154 · Cited by 7
Incremental Detection of Hyperspectral Targets in Consistent Scenes With Continuous Learning
Dong, W., Chen, Y., Xiao, S., Qu, J., & Li, Y. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3461868 · Cited by 7
DST: Continual event prediction by decomposing and synergizing the task commonality and specificity
Zhang, Y., Zhai, S., Chen, Y., Zhang, S., Bi, S., Meng, Y., & Qi, G. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103899 · Cited by 7
BeGin: Extensive Benchmark Scenarios and an Easy-to-use Framework for Graph Continual Learning
Ko, J., Kang, S., Kwon, T., Moon, H., & Shin, K. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3702648 · Cited by 11
Prompt Customization for Continual Learning
Dai, Y., Hong, X., Wang, Y., Ma, Z., Jiang, D., & Wang, Y. (2025) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3524977 · Cited by 10
Machine Unlearning Through Fine-Grained Model Parameters Perturbation
Zuo, Z., Tang, Z., Li, K., & Datta, A. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2025.3528551 · Cited by 7
Continual learning with Bayesian compression for shared and private latent representations
Yang, Y., Guo, D., Chen, B., & Hu, D. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107167 · Cited by 7
Das, D., Talon, D., Mancini, M., Wang, Y., & Ricci, E. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00550 · Cited by 7
Chen, H., Guan, L., Lin, B., Chen, L., Huang, J., & Li, Y. (2025) · Electric Power Systems Research · doi:10.1016/j.epsr.2025.111704 · Cited by 7
Where’s That Voice Coming? Continual Learning for Sound Source Localization
Xiao, Y., & Das, R. K. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209062 · Cited by 7
Exemplar-Supported Representation for Effective Class-Incremental Learning
Guo, L., Xie, G., Xu, X., & Ren, J. (2020) · IEEE Access · doi:10.1109/access.2020.2980386 · Cited by 7
Kutalev, A., & Lapina, A. (2021) · Sovremennye informacionnye tehnologii i IT-obrazovanie. · doi:10.25559/sitito.17.202102.345-354 · Cited by 12
Scalability of knowledge distillation in incremental deep learning for fast object detection
Yuwono, E. I., Tjondonegoro, D., Sorwar, G., & Alaei, A. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109608 · Cited by 7
Leveraging joint incremental learning objective with data ensemble for class incremental learning
Mazumder, P., Karim, M. A., Joshi, I., & Singh, P. P. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.01.017 · Cited by 7
Avoiding Forgetting and Allowing Forward Transfer in Continual Learning via Sparse Networks
Sokar, G., Mocanu, D. C., & Pechenizkiy, M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26409-2_6 · Cited by 7
GFR: Generic feature representations for class incremental learning
Wang, Z., Xu, L., Qiu, Z., Wu, Q., Meng, F., & Li, H. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126410 · Cited by 8
Online Active Continual Learning for Robotic Lifelong Object Recognition
Nie, X., Deng, Z., He, M., Fan, M., & Tang, Z. S. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3308900 · Cited by 9
EdgeFD: An Edge-Friendly Drift-Aware Fault Diagnosis System for Industrial IoT
Chen, J., Mao, F., Lv, Z., & Tang, J. (2023) · IEEE International Conference on Communication Technology (ICCT) · doi:10.1109/icct59356.2023.10419797 · Cited by 10
Continual Learning with Diffusion-based Generative Replay for Industrial Streaming Data
He, J., Chen, J., Liu, Q., Dai, S., Tang, J., & Liu, D. (2024) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/iccc62479.2024.10682047 · Cited by 8
Schematic memory persistence and transience for efficient and robust continual learning
Gao, Y., Ascoli, G. A., & Zhao, L. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.08.011 · Cited by 7
Incremental human action recognition with dual memory
Gutoski, M., Lazzaretti, A. E., & Lopes, H. S. (2021) · Image and Vision Computing · doi:10.1016/j.imavis.2021.104313 · Cited by 7
Automatic Recall Machines: Internal Replay, Continual Learning and the BrainPreprint
Ji, X., Henriques, J. F., Tuytelaars, T., & Vedaldi, A. (2020) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.48550/arxiv.2006.12323 · Cited by 14
Self-citationContinual Learning in Human Activity Recognition: an Empirical Analysis of RegularizationPreprint
Jha, S., Schiemer, M., & Ye, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.03032 · Cited by 7
Bilevel Continual LearningPreprint
Pham, Q., Sahoo, D., Liu, C., & Hoi, S. C. H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.15553 · Cited by 9
Lifelong Learning with Sketched Structural RegularizationPreprint
Li, H., Krishnan, A., Wu, J., Kolouri, S., Pilly, P. K., & Braverman, V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.08604 · Cited by 7
On-device synaptic memory consolidation using Fowler-Nordheim quantum-tunneling
Rahman, M., Bose, S., & Chakrabartty, S. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2022.1050585 · Cited by 9
Few-shot class incremental learning via robust transformer approach
Paeedeh, N., Pratama, M., Wibirama, S., Mayer, W., Cao, Z., & Kowalczyk, R. (2024) · Information Sciences · doi:10.1016/j.ins.2024.120751 · Cited by 6
Background debiased class incremental learning for video action recognition
Nguyen, L. Q., Choi, J., Dang, L. M., & Moon, H. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.105295 · Cited by 7
EdgeTA: Neuron-Grained Scaling of Foundation Models in Edge-Side Retraining
Zhang, Q., Han, R., Liu, C. H., Wang, G., Guo, S., & Chen, L. Y. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3504859 · Cited by 6
Probabilistic metaplasticity for continual learning with memristors in spiking networks
Zohora, F. T., Karia, V., Soures, N., & Kudithipudi, D. (2024) · Scientific Reports · doi:10.1038/s41598-024-78290-w · Cited by 8
Similarity-based context aware continual learning for spiking neural networks
Han, B., Zhao, F., Li, Y., Kong, Q., Li, X., & Zeng, Y. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.107037 · Cited by 6
Training Networks in Null Space of Feature Covariance With Self-Supervision for Incremental Learning
Wang, S., Li, X., Sun, J. Z., & Xu, Z. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3522258 · Cited by 6
Replay-Based Incremental Object Detection With Local Response Exploration
Zhong, J., Jiao, Y., & Bao, B. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3535403 · Cited by 9
Iqbal, S., Zhong, X., Khan, M. A., Shabaz, M., Wu, Z., AlHammadi, D. A., Liu, W., Algamdi, S. A., & Li, Y. (2025) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2025.3563986 · Cited by 6
Class Incremental Learning with probability dampening and cascaded gated classifier
Pomponi, J., Devoto, A., & Scardapane, S. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130295 · Cited by 6
Multi-View Fusion Graph Attention Network for Multilabel Class Incremental Learning
Tan, A., Wang, Y., Wu, W.-Z., Ding, W., & Liang, J. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103309 · Cited by 6
Continual learning by gradient monitoring for remaining useful lifetime estimation
Shah, S. R. B., & Schwung, A. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113721 · Cited by 6
Guo, Q., Zhao, C., & Gao, X. (2025) · Solar Energy · doi:10.1016/j.solener.2025.113787 · Cited by 6
WaveMem-SHAPNet: A Transparent Deep Learning Approach to Early Diagnosis of Diabetic Retinopathy
Kirubakaran, M., & Vijayarajan, V. (2026) · SN Computer Science · doi:10.1007/s42979-025-04632-8 · Cited by 7
Multi-Stage Knowledge Integration of Vision-Language Models for Continual Learning
Zhang, H., Ji, Z., Liu, J., Pang, Y., & Han, J. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3652014 · Cited by 7
Gradient Decomposition and Alignment for Incremental Object Detection
Luo, W., Zhang, X., Cheng, D., Xing, Y., Liang, G., Wang, P., & Zhang, Y. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00427 · Cited by 6
倪, 宣., 沈, 鑫., & 张, 海. (2021) · Scientia Sinica Informationis · doi:10.1360/ssi-2021-0152 · Cited by 6
An Efficient Incremental Learning Algorithm for Sound Classification
Hussain, M. A., Lee, C.-L., & Tsai, T. (2022) · IEEE Multimedia · doi:10.1109/mmul.2022.3208923 · Cited by 6
OpenDrift: Online Evolving Fraud Detection for Open-Category and Concept-Drift Transactions
Wang, C., Chai, S., & Zhu, H. (2023) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws60048.2023.00079 · Cited by 6
SAR Incremental Automatic Target Recognition Based on Mutual Information Maximization
Li, B., Cui, Z., Wang, H., Deng, Y., Ma, J., Yang, J., & Cao, Z. (2024) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2024.3368063 · Cited by 6
CAT: Continual Adapter Tuning for aspect sentiment classification
Chen, Q., Huang, J., Wen, W., Li, Q., Zhang, R., & Qin, J. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127423 · Cited by 6
Class Incremental Learning via Semantic Information Mapping and Background Information Calibrating
Xian, Y., Yu, H. Z., Li, H., & Wang, G. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3447066 · Cited by 7
NICE: Neurogenesis Inspired Contextual Encoding for Replay-free Class Incremental Learning
Gürbüz, M. B., Moorman, J. M., & Dovrolis, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02233 · Cited by 6
TAME: Task Agnostic Continual Learning using Multiple Experts
Zhu, H., Majzoubi, M., Jain, A., & Choromanska, A. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00417 · Cited by 13
Continual Learning for Remote Physiological Measurement: Minimize Forgetting and Simplify Inference
Liang, Q. Y., Chen, Y., & Hu, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72764-1_8 · Cited by 6
FTF-ER: Feature-Topology Fusion-Based Experience Replay Method for Continual Graph Learning
Pang, J., Lin, C., Hao, X., Yin, R., Wang, Z., Zhang, Z., He, J., & Huang, T. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681457 · Cited by 6
Calibrating Prompt from History for Continual Vision-Language Retrieval and Grounding
Jin, T., Yan, W. B., Wang, Y., Cai, S., Shuai, Q., & Zhao, Z. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681387 · Cited by 6
CL-MASR: A Continual Learning Benchmark for Multilingual ASR
Libera, L. D., Mousavi, P., Zaiem, S., Subakan, C., & Ravanelli, M. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3487410 · Cited by 12
HiDe-PET: Continual Learning via Hierarchical Decomposition of Parameter-Efficient Tuning
Wang, L., Xie, J., Zhang, X., Su, H., & Zhu, J. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3562534 · Cited by 8
CL-BioGAN: Biologically Inspired Cross-Domain Continual Learning for Hyperspectral Anomaly Detection
Wang, J., Zheng, H., Zhang, W., Hao, S., Yao, Y., & Gong, M. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3561174 · Cited by 6
Auxiliary Local Variables for Improving Regularization/Prior Approach in Continual Learning
Van, L. N., Hai, N. L., Pham, H., & Than, K. Q. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-05933-9_2 · Cited by 6
Li, J., Diao, W., Lü, X., Wang, P., Zhang, Y., Yang, Z., Xu, G., & Sun, X. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3199584 · Cited by 6
Continual Referring Expression Comprehension via Dual Modular Memorization
Shen, H. T., Chen, C., Wang, P., Gao, L., Wang, M., & Song, J. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3212317 · Cited by 6
Wang, B., Zhang, D., & Tian, Z. (2023) · Electronics · doi:10.3390/electronics12040866 · Cited by 6
Continual relation extraction via linear mode connectivity and interval cross training
Chen, Q., Sun, J., Palade, V., & Yu, Z. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110288 · Cited by 7
Multi-Scopic Cognitive Memory System for Continuous Gesture Learning
Dou, W., Chin, W., & Kubota, N. (2023) · Biomimetics · doi:10.3390/biomimetics8010088 · Cited by 6
Incremental Learning-Based Algorithm for Anomaly Detection Using Computed Tomography Data
Gabbar, H. A., Adegboro, O. G., Chahid, A., & Jing Ren, A. (2023) · Computation · doi:10.3390/computation11070139 · Cited by 6
The Importance of Robust Features in Mitigating Catastrophic Forgetting
Khan, H., Bouaynaya, N. C., & Rasool, G. (2023) · IEEE Symposium on Computers and Communications (ISCC) · doi:10.1109/iscc58397.2023.10218203 · Cited by 6
Unsupervised open-world human action recognition
Gutoski, M., Lazzaretti, A. E., & Lopes, H. S. (2023) · Pattern Analysis and Applications · doi:10.1007/s10044-023-01202-7 · Cited by 6
Pseudo Object Replay and Mining for Incremental Object Detection
Yang, D., Zhou, Y., Hong, X., Zhang, A., Wei, X., Zeng, L., Qiao, Z. Q., & Wang, W. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611952 · Cited by 6
Wang, T., Li, M., Zheng, R., Cai, C., Lou, Y., & Zhu, S. (2023) · Applied Intelligence · doi:10.1007/s10489-023-05034-0 · Cited by 6
CUCL: Codebook for Unsupervised Continual Learning
Chen, C., Song, J., Zhu, X., Zhu, J., Gao, L., & Shen, H. T. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611713 · Cited by 6
Growing a Brain with Sparsity-Inducing Generation for Continual Learning
Jin, H., Kim, G.-H., Ahn, C., & Kim, E. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01738 · Cited by 8
SimCS: Simulation for Domain Incremental Online Continual Segmentation
Alfarra, M., Cai, Z., Bibi, A., Ghanem, B., & Müller, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i10.28952 · Cited by 8
Few-Shot Continual Learning via Flat-to-Wide Approaches
Ma’Sum, M. A., Pratama, M., Lughofer, E. D., Liu, L., Habibullah, & Kowalczyk, R. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3415048 · Cited by 6
Kharrat, A., Drira, F., Lebourgeois, F., & Kerautret, B. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128217 · Cited by 7
Lifelong Learning Without a Task Oracle
Rios, A., & Itti, L. (2020) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai50040.2020.00049 · Cited by 6
Continual Learning for Classification Problems: A Survey
Vijayan, M., & Sridhar, S. S. (2021) · IFIP advances in information and communication technology · doi:10.1007/978-3-030-92600-7_15 · Cited by 6
Schema-adaptable Knowledge Graph Construction
Ye, H., Gui, H., Xu, X., Chen, X., Chen, H., & Zhang, N. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.425 · Cited by 10
Continual Representation Learning via Auto-Weighted Latent Embeddings on Person ReID
Huang, T., Qu, W., & Zhang, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-88010-1_50 · Cited by 6
Attention-Based Structural-PlasticityPreprint
Kolouri, S., Ketz, N., Zou, X., Krichmar, J. L., & Pilly, P. K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.06070 · Cited by 6
Incremental Learning with Unlabeled Data in the WildPreprint
Lee, K., Lee, K., Shin, J., & Lee, H. (2019) · arXiv (Cornell University) · Cited by 6
Neural Network Retraining for Model ServingPreprint
Klabjan, D., & Zhu, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.14203 · Cited by 6
Metadata
- Authors
- Aljundi, R., Babiloni, F., Elhoseiny, M., Rohrbach, M., & Tuytelaars, T.
- Affiliations
- IMEC (BE)
- Meta (United States) (US)
- Corresponding author
- Aljundi, Rahaf
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer International Publishing
- Published
- 2018
- Pages
- 144-161
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W2768412495
- Semantic Scholar
- 713b0d9005944f80af00addc81b162ca74ea4b14
- Cited by
- 1,590
- References
- 37
- Citations by year
- 2026: 166 · 2025: 281 · 2024: 288 · 2023: 295 · 2022: 184 · 2021: 203 · 2020: 105 · 2019: 52 · 2018: 15
- FWCI
- 38.29
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Lecture notes in computer science (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Lirias (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- Fonds Wetenschappelijk Onderzoek
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- catastrophic forgetting, lifelong learning, parameter importance, neuroplasticity, Hebbian learning, online learning, object recognition, knowledge preservation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-08, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-08 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
