Mez: An Adaptive Messaging System for Latency-Sensitive Multi-Camera Machine Vision at the IoT Edge
Open accessAbstract
Mez is a novel publish-subscribe messaging system for latency sensitive multi-camera machine vision applications at the IoT Edge. The unlicensed wireless communication in IoT Edge systems are characterized by large latency variations due to intermittent channel interference. To achieve user specified latency in the presence of wireless channel interference, Mez takes advantage of the ability of machine vision applications to temporarily tolerate lower quality video frames if overall application accuracy is not too adversely affected. Control knobs that involve lossy image transformation techniques that modify the frame size, and thereby the video frame transfer latency, are identified. Mez implements a network latency feedback controller that adapts to channel conditions by dynamically adjusting the video frame quality using the image transformation control knobs, so as to simultaneously satisfy latency and application accuracy requirements. Additionally, Mez uses an application domain specific design of the storage layer to provide low latency operations. Experimental evaluation on an IoT Edge testbed with a pedestrian detection machine vision application indicates that Mez is able to tolerate latency variations of up to 10x with a worst-case reduction of 4.2% of the application accuracy F1 score metric. The performance of Mez is also experimentally evaluated against state-of-the-art low latency NATS messaging system.
AI snapshot
Written from the paper’s full text.
TL;DR
Mez is an adaptive publish-subscribe messaging system for latency-sensitive multi-camera machine vision at the IoT Edge that trades temporary video-frame quality reduction for lower wireless transfer latency. On an IoT Edge testbed with OpenPose pedestrian detection, Mez tolerated latency variations up to 10x with a worst-case F1 accuracy reduction of 4.2%.
Key findings
- Mez achieved target latency under 100 ms with application accuracy above 95% for complex-scene video frames, where uncontrolled median latency was 260 ms for JAAD and 650 ms for DukeMTMC; settling time was less than one second.
- With IoT camera nodes scaled from 1 to 5, Mez maintained per-frame pub-sub latency under 100 ms, while NATS showed a super-linear latency increase; Mez’s worst-case accuracy reduction was 3.3% for JAAD and less than 4.2% for DukeMTMC.
- In end-to-end latency breakdown with 5 IoT camera nodes and complex JAAD frames, network latency dominated at 96.2% for NATS and 65.7% for Mez, with Mez’s controller overhead next at 20.5%.
- Mez tolerated latency variations of up to 10x with a worst-case reduction of 4.2% in the application accuracy F1 score metric.
Methods
- Testbed: five IoT camera nodes on 8-core ARMv8.2 Nvidia Jetson AGX Xavier boards, one Nvidia Titan V GPU Edge server, NETGEAR Nighthawk XR700 802.11ac (5 GHz) WiFi access point, nodes at 6 m, PTP time synchronization; video datasets JAAD and DukeMTMC.
- Application and metric: OpenPose multi-person 2D pose detection for pedestrian detection, evaluated with F1 score at IoU threshold 0.5; latency measured as 95th percentile at 5 fps.
- Mez design/evaluation: five lossy image transformation “tuning knobs” (resolution, colorspace, blurring, artifact removal, frame differencing), a network latency controller using PI control plus lookup tables, and an in-memory append-only circular log; evaluation compared Mez against NATS for IoT-node and subscriber scaling.
Limitations
- Stated: Mez does not support replicated physical nodes; if an IoT node fails its camera frames become unavailable, and if the Edge server fails the entire system becomes unavailable. It also has no inherent broker restart mechanism and relies on external services such as Kubernetes.
- Stated: security work such as RBAC and container-image authenticity verification is left to future work; only the Xavier CPU was used, not its GPU; and the paper focuses on network latency, leaving joint compute/network latency optimization to future work.
- Evident: evaluation is limited to one machine vision application (OpenPose pedestrian detection), two datasets, five IoT camera nodes, and 802.11ac WiFi; the controller also assumes prior characterization of latency versus frame size and accuracy versus knob settings for the target deployment/application.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
4 of 18 cited sources checked · 0 supported · 0 flagged · accuracy not yet measured
- Findingcitation
Blurring the video frames can reduce the video frame size by as much as 46%.
“Blurring the video frames can reduce the video frame size by as much as 46%.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [23] source
Section 2.2 describes capturing and streaming video frames, and Section 3.3 discusses frame compression and transmission latency. Neither passage reports blurring frames or a 46% reduction in frame size; searches for “blurring” and “46%” found no supporting passage in our copy. (LLM, conf=0.75)
Experimental — accuracy not yet measured
- Findingcitation
Removing artifact information can reduce the video frame size by as much as 98%.
“Removing artifact information can reduce the video frame size by as much as 98%.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [23] source
The Gabriel Platform section (page unavailable) describes streaming a subset of image frames in MJPEG format, and §3.3 (page unavailable) describes compressing frames before transmission. Neither reports removing artifact information or a 98% reduction in frame size; searches for those terms and “98%” found no supporting passage in our copy. (LLM, conf=0.72)
Experimental — accuracy not yet measured
- Findingcitation
Colorspace modifications can reduce the video frame size by as much as 62%.
“Our choice of color space modifications can reduce the video frame size by as much as 62%.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [23] source
Section 2.2 describes streaming image frames in MJPEG format, and Section 3.3 discusses compressing frames and transmitting them. Neither passage, nor the additional passages searched for “62%” and color-space modifications, reports a 62% reduction in frame size from changing color space. (LLM, conf=0.72)
Experimental — accuracy not yet measured
- Findingcitation
Modifying resolution can reduce the video frame size by as much as 84%.
“Modifying resolution can reduce the video frame size by as much as 84%.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [23] source
Section 2.2 describes capturing 640×360 frames, and section 3.5 discusses compression and transmission differences across devices. Neither reports changing resolution or an 84% reduction in frame size (searched: resolution, frame size, 84%). (LLM, conf=0.70)
Experimental — accuracy not yet measured
- Findingown data
In experimental evaluation on an IoT Edge testbed with a pedestrian detection machine vision application, Mez tolerates latency variations of up to 10x with a worst-case reduction of 4.2% of the application accuracy F1 score metric.
“Experimental evaluation on an IoT Edge testbed with a pedestrian detection machine vision application indicates that Mez is able to tolerate latency variations of up to 10x with a worst-case reduction of 4.2% of the application accuracy F1 score metric.”
- Also stated in: § FIGURE 1. · hedged
“Experimental results indicate that for pedestrian detection application with the OpenPose multiperson 2D pose detection benchmark [14]- [17], Mez is able to achieve the target latency in the presence of up to 10x increase in channel interference with an application accuracy degradation of at most 4.2%.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [14]- [17]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Also stated in: § FIGURE 1. · hedged
- Findingcitation
The state-of-the-art NATS messaging framework suffers from latency degradation as the number of IoT camera nodes scale.
“In contrast, the state-of-the-art NATS messaging framework suffers from latency degradation as the number of IoT camera nodes scale.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [11]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingown data
In an IoT machine vision application with multiple cameras transmitting video frames to the Edge server, a significant rise in network latency is observed at each IoT node as the number of peer nodes scale.
“The measurement results indicate that in an IoT machine vision application with multiple cameras transmitting video frames to the Edge server, a significant rise in network latency is observed at each IoT node as the number of peer nodes scale.”
Quote in the paperSubstantial claim - Findingown data
With no latency control, the median latency for DukeMTMC complex scene dynamics video frames is 650 ms due to interference from the 4 peer Edge nodes.
“With no latency control, the median latency is 650 ms for complex scene dynamics due to interference from the 4 peer Edge nodes.”
Quote in the paperSubstantial claim - Findingown data
With the controller enabled, the median latency for JAAD complex scene dynamics video frames is less than the 100 ms latency threshold.
“With the controller enabled, the median latency is less than the latency threshold of 100ms.”
Quote in the paperSubstantial claim - Findingown data
With the controller enabled, the application accuracy for JAAD complex scene dynamics video frames is above 96%.
“The controller is able to achieve an application accuracy of above 96%.”
Quote in the paperSubstantial claim - Findingown data
Wi-Fi transmission latency shows an approximately linear variation with video frame size.
“From Figure 5 we note that the Wi-Fi transmission latency shows an approximately linear variation with video frame size.”
Quote in the paperSubstantial claim - Findingown data
For the JAAD frame, a group of two individuals detected correctly in the unmodified video frame is detected as a single box in the modified video frame.
“A group of two individuals are detected correctly in the unmodified video frame, but detected as a single box in the modified video frame.”
Quote in the paperNot a substantial claim - Findingown data
With no latency control, the median latency for JAAD complex scene dynamics video frames is 260 ms due to interference from the 4 peer Edge nodes.
“With no latency control, the median latency is 260 ms due to interference from the 4 peer Edge nodes.”
Quote in the paperSubstantial claim - Findingown data
For both JAAD and DukeMTMC, apart from the noted detection errors, the other detections in the modified frame are the same as in the unmodified frame.
“We note that for both datasets, apart from the aforementioned detection errors, the other detections in the modified frame are same as the unmodified frame.”
Quote in the paperNot a substantial claim - Findingown data
With the controller enabled, the median latency for DukeMTMC complex scene dynamics video frames is less than the 100 ms latency threshold.
“With the controller enabled, the median latency is less than the latency threshold of 100ms.”
Quote in the paperSubstantial claim - Findingown data
For a stream of 100 simple dynamics images from the JAAD data set, frame differencing reduces the median image size by up to 40%.
“For a stream of 100 simple dynamics images from the JAAD data set, this knob reduces the median image size by up to 40%.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [19] source
- Findingreasoning
The pub-sub latency of NATS shows a super-linear increase with IoT node scaling.
“However, the pub-sub latency of NATS shows a super-linear increase with IoT node scaling, since NATS does not perform any type of network latency control.”
Quote in the paperSubstantial claim - Findingown data
Mez has a higher pub-sub latency than NATS due to controller overheads.
“However, Mez has a higher latency than NATS due to controller overheads.”
Quote in the paperNot a substantial claim - Findingown data
Pedestrian detection compute latency increases with increase in resolution and image size.
“Figure 17 shows that the pedestrian detection compute latency increases with increase in resolution and image size.”
Quote in the paperNot a substantial claim - Findingown data
For NATS, network latency dominates the overall pub-sub latency at 96.2%.
“For NATS, the network latency dominates the overall latency at 96.2%.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Mez supports at-most-once delivery of video frames to the subscriber to limit bandwidth consumption on the wireless channel.
“Mez supports at-most-once delivery of video frames to the subscriber to limit the bandwidth consumption on the wireless channel.”
Quote in the paperSubstantial claim - Premisecitation
IoT machine vision applications are an ideal candidate for the Edge computing paradigm, where most processing of video streams happens in the vicinity of the camera.
“IoT machine vision applications are thus an ideal candidate for the Edge computing paradigm [5]- [9], where most of the processing of the video streams happen in the vicinity of the camera.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [5]- [9]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationown data
A 4x reduction in video frame size could potentially yield a 4x reduction in wireless network latency.
“A 4x reduction in video frame size could potentially yield a 4x reduction in wireless network latency.”
Quote in the paperSubstantial claim - Interpretationreasoning
Under dynamically varying network latency conditions, Mez uses a network latency controller to automatically adjust video frame quality such that the application specified network latency and accuracy bounds are met.
“Under dynamically varying network latency conditions, Mez uses this latency controller to automatically adjust video frame quality such that the application specified network latency, and accuracy bounds are met.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Network latency for different video frame sizes is available from prior characterization of the video frames in the targeted deployment environment.
- The authors state this as an assumption: Application accuracy for different tuning knob settings is available for the targeted application through prior characterization.
- Interpretationnone given
The network latency controller resides on the IoT camera nodes and modifies the video frames transmitted to the Edge server to satisfy the latency-accuracy requirements of the subscriber.
“The network latency controller resides on the IoT camera nodes, and modifies the video frames transmitted to the Edge server to satisfy the latency-accuracy requirements of the subscriber.”
Quote in the paperSubstantial claim - Interpretationown data
It is possible to compensate for increased network latency in the presence of channel interference by reducing video frame quality just sufficiently such that application accuracy demands are met, where feasible.
“From the measurements in Sections II-C and Sections II-D we note the possibility of compensating for the increased network latency in the presence of channel interference through reducing the video frame quality just sufficiently, such that application accuracy demands are met (where feasible).”
Quote in the paperSubstantial claim - Interpretationown data
The almost linear dependence of latency on image size observed in Section II-C1 facilitates the use of a linear regression model of latency on video frame size.
“The almost linear dependence of latency on image size observed in Section II-C1 facilitates the use of linear regression model of latency on video frame size.”
Quote in the paperSubstantial claim - Interpretationown data
Mez is able to tolerate latency variations of up to 10x with a drop in application accuracy of less than 4.2%.
“Our experimental evaluation of Mez on an IoT Edge testbed with a pedestrian detection machine vision application indicates that Mez is able to tolerate latency variations of up to 10x with a modest drop in application accuracy of less than 4.2%.”
Quote in the paperSubstantial claim- Rests on an assumption: Many machine vision applications support the approximate computing paradigm, where useful enough results can be obtained despite reduced quality input.
- Premisenone given
None of the previously reported Edge machine vision works address guaranteeing latency requirements at the Edge for machine vision applications.
“However, none of these works address guaranteeing of latency requirements at the Edge for machine vision applications.”
Quote in the paperNot a substantial claim - Interpretationown data
The compute latency is only dependent on the resolution of the images.
“We note that, the compute latency is only dependent on the resolution of the images.”
Quote in the paperNot a substantial claim - Interpretationown data
Unlike Mez, NATS is unable to adapt to the dynamic environments of the IoT Edge.
“Unlike Mez, NATS is unable to adapt to the dynamic environments of the IoT Edge.”
Quote in the paperSubstantial claim - Interpretationreasoning
If the Edge server fails, the entire Mez system becomes unavailable.
“However, if the Edge server fails, then entire system becomes unavailable.”
Quote in the paperNot a substantial claim - Interpretationnone given
Mez incorporates a latency controller that adapts operation to the wireless channel condition using different image transformations as tuning knobs, to transmit video frames that simultaneously satisfy accuracy and latency constraints.
“Mez incorporates a novel latency controller that adapts operation to the wireless channel condition using different image transformations as tuning knobs, to transmit video frames that simultaneously satisfies accuracy and latency constraints.”
Quote in the paperSubstantial claim- Rests on an assumption: Many machine vision applications support the approximate computing paradigm, where useful enough results can be obtained despite reduced quality input.
- Classified as probably not a substantial claim. 14
- May combine two claims. 20
- The quote only partly states this claim. 3
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenFor the DukeMTMC frame, the detection boxes in the modified video frame are thinner than those in the unmodified video frame.
“For the DukeMTMC frame, the detection boxes in the modified video frame are thinner than those in the unmodified video frame.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataWhen the number of IoT nodes is scaled from 1 to 5, Mez maintains the pub-sub latency under 100 ms while keeping the accuracy reduction below 4.2% for the DukeMTMC dataset.
“When the number of IoT nodes is scaled from 1 to 5, Mez is able to maintain the pub-sub latency under 100ms (Figure 14a) while maintaining the accuracy reduction less than 4.2% (Figure 14b).”
Quote in the paperSubstantial claimThe quote only partly states this claim.
Findingown dataMez shows a worst-case accuracy reduction of 3.3% for the JAAD dataset.
“Mez shows a worst case accuracy reduction of 3.3%.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataFor video frames with complex scene dynamics, the ratio of FIVE Lat to ONE Lat is 5.6x for the JAAD dataset and 8.4x for the DukeMTMC dataset.
“We note that for video frames with complex scene dynamics, the ratio FIVE Lat /ONE Lat is 5.6x for the JAAD dataset, and 8.4x for the DukeMTMC dataset.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [19] source
- cites [20]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Findingown dataVideo frame modification by the network latency controller causes an accuracy loss of 3.3% for JAAD and 4.2% for DukeMTMC complex scene dynamics frames.
“Pedestrian detections for the unmodified video frames (green), and after video frame modification (blue) by the network latency controller are shown (accuracy loss of 3.3% for JAAD and 4.2% for DukeMTMC).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe FIVE Lat at 15 fps is 1.02x higher for DukeMTMC compared to 5 fps, and at 12m is 1.06x higher compared to 6m.
“We note that the FIVE Lat at 15 fps is 1.02x higher for DukeMTMC compared to 5 fps, and at 12m is 1.06x higher compared to 6m.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [20]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataNATS could not be evaluated on the DukeMTMC dataset because its median video frame size exceeds NATS's 1 MB message size limit.
“Since the median video frame size for DukeMTMC is greater than 1 MB, we could not evaluate NATS due to its 1 MB message size limit.”
Quote in the paperNot a substantial claimThe quote only partly states this claim.
Findingown dataAs the number of IoT camera nodes scales from 1 to 5, Mez maintains the pub-sub latency under 100 ms for the JAAD dataset.
“As seen from Figure 13a, when the number of IoT nodes are increased, Mez is able to maintain the pub-sub latency under 100ms.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Findingnone givenA 1 GB in-memory log at the IoT camera node holds approximately 7 minutes worth of video frames, assuming 500 kB per frame and 5 fps.
“A 1 GB of in-memory log at the IoT camera node holds approximately 7 minutes worth of video frames (assuming 500 kB per frame, and 5 fps).”
Quote in the paperSubstantial claimThe quote only partly states this claim.
Findingown dataScene dynamics, frame rate, and distance of IoT camera nodes from the Edge server are less significant factors affecting latency than peer node interference.
“Additionally, factors affecting latency include scene dynamics; frame rate, and distance of IoT camera nodes from the Edge server are less significant.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningMultiple knob combinations map to the same video frame size and network latency, but can result in different application accuracy.
“We also note that multiple knob combinations map to the same video frame size (and hence network latency).However, these knob combinations could result in different application accuracy -which we characterize in the next section.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataIn all cases, the controller achieves an application accuracy above 95% with a settling time of less than one second.
“In all cases, the controller is able to achieve an application accuracy of above 95% with a settling time of less than one second.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningNATS maintains the maximum accuracy for all cases because it always sends unmodified images.
“Since NATS always sends unmodified images, it maintains the maximum accuracy for all cases.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataFor Mez, network latency is the dominant component of pub-sub latency at 65.7%, with controller overhead next highest at 20.5%.
“For Mez, the network latency is the dominant component at 65.7%, with the controller overhead being the next highest at 20.5%.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataBoth Mez and NATS scale well as the number of subscribers increases from 1 to 8, with minimal degradation in latency.
“Both Mez and NATS scale well as the number of subscribers are increased from 1 to 8 with minimal degradation in latency.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataAbout half the controller processing time is due to video frame modification, with video frame copying between the logs at IoT camera nodes accounting for the remaining time.
“About half the controller processing time is due to the video frame modification, with the video frame copying between the logs at IoT camera nodes accounting for the remaining time.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataMachine vision applications can tolerate errors in video frame data, which allows the use of simpler transport protocols such as UDP that do not support re-transmissions.
“Also, in practice we observe that the ability of machine vision applications to tolerate errors in the video frame data, allows the use of simpler transport protocols (UDP) that does not support re-transmissions.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductcitationThe Edge nodes and the Edge server were synchronized using the PTP synchronization protocol before the start of the measurements.
“The Edge nodes and the Edge server are synchronized using PTP synchronization protocol [22] before the start of the measurements.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [22]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
Study design and conductcitationThe IoT camera nodes are time synchronized to the Edge server before starting the network latency measurements using the PTP network level time synchronization protocol capable of microsecond accuracy.
“The IoT camera nodes are time synchronized to the Edge server before starting the network latency measurements using the PTP network level time synchronization protocol capable of microsecond accuracy [22].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [22]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
InterpretationreasoningThe lack of a need to support update and delete operations, and the sorted video frames in the log, simplify the design of the log and prevent memory fragmentation.
“The lack of a need to support update and delete operations, and the sorted (by timestamps) video frames in the log, simplify the design of the log and prevent memory fragmentation.”
Quote in the paperSubstantial claim- Rests on an assumption: Machine vision applications at the IoT Edge do not need to support delete operations.
May combine two claims.
InterpretationreasoningLocalized processing of video streams at the Edge potentially allows for low latency operation, overcomes bandwidth limitations by reducing the size of data sent to the Cloud, and helps address privacy and legal concerns by eliminating the need to share raw video frames with Cloud vendors.
“The localized processing of video streams at the Edge potentially allows for low latency operation, overcomes bandwidth limitations by reducing the size of the data that needs to be sent to the Cloud, and helps addresses privacy and legal concerns by eliminating the need to share raw video frames with Cloud vendors.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataNetwork latency is dynamic due to scene changes and the intermittent nature of external interference.
“to scene changes (simple to complex), and the intermittent nature of external interference.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
InterpretationreasoningThe on-demand transfer of video frames reduces channel interference by limiting unneeded transmission in the wireless channel.
“The ondemand transfer of video frames reduces channel interference by limiting unneeded transmission in the wireless channel.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisereasoningExisting messaging systems are built for the Cloud, where machines communicate over low latency wired networks, and do not provide mechanisms to guarantee latency when operating in wireless channels with large latency variations.
“However, the existing messaging systems are built for the Cloud, where machines communicate over low latency wired networks (Gigabit Ethernet, Infiniband), and as such do not provide mechanisms to guarantee latency when operating in wireless channels with large latency variations.”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [10]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [11]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [12] source
May combine two claims.
Interpretationnone givenThe latency controllers on each IoT camera node operate independently of one another, and the lack of centralized control allows the scaling of the IoT camera nodes.
“Note that the latency controllers on each IoT camera node operate independently of one another.The lack of centralized control allows the scaling of the IoT camera nodes.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Interpretationnone givenThe design of Mez storage is targeted to provide low latency read-write operations.
“The design of Mez storage is targeted to provide low latency read-write operations.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
InterpretationreasoningThe reduced transmission also serves as a power saving opportunity at the IoT camera node.
“Additionally, the reduced transmission also serves as a power saving opportunity at the IoT camera node.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningThe persistent storage is only used to reconstruct the in-memory log during reboot after node failure.
“The persistent storage is only used to reconstruct the in-memory log during reboot after node failure (see Section IV-D).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenThe impact of lower sized video frames on machine vision task accuracy is dependent on the particular machine vision application.
“In general, the impact is dependent on the particular machine vision application.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe in-memory logs are persisted on durable storage on both the IoT camera nodes and the Edge server, but all requests are served from the in-memory log to minimize storage latency.
“The in-memory logs are persisted on durable storage (SSD/disk) on both the IoT camera nodes, and the Edge server.However, to minimize storage latency, all requests are served from the in-memory log.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: For the short time duration the video frames are held in DRAM, the data is safe from illegal access due to the volatile nature of the memory.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningDue to the possible physical insecurity of the hardware, the video frames stored on disk are encrypted at rest.
“Due to the possible physical insecurity of the hardware, the video frames stored on disk are encrypted at rest.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Interpretationnone givenEncryption/decryption and disk accesses are relatively long latency operations, motivating the avoidance of disk access in the read/write critical path.
“The encryption/decryption, and disk accesses are relatively long latency operations, motivating the avoidance of disk access in the read/write critical path.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationNATS is a general purpose messaging system and does not provide latency guarantees.
“However, unlike Mez, NATS is a general purpose messaging system, and does not provide latency guarantees.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [11]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Interpretationnone givenThe current version of Mez does not support replicated physical nodes, neither IoT camera nodes nor Edge server.
“Regarding service availability, the current version of Mez does not support replicated physical nodes (neither IoT camera nodes, nor Edge sever).”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisecitationA low quality H.264-encoded 1080p stream is insufficient to perform accurate analysis for vision analytic applications such as traffic monitoring and pedestrian tracking.
“However, Canel et al. [26] suggest that a low quality H.264-encoded 1080p (1920 × 1080 pixels) stream is insufficient to perform accurate analysis for vision analytic applications such as traffic monitoring and pedestrian tracking.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Canel et al. [26]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
The authors state this as an assumption.
Network latency for different video frame sizes is available from prior characterization of the video frames in the targeted deployment environment.
“The network latency for different video frame sizes (see Section II-C) are assumed to be available from prior characterization of the video frames in the targeted deployment environment.”
The authors state this as an assumption.
Application accuracy for different tuning knob settings is available for the targeted application through prior characterization.
“The application accuracy for different tuning knob settings is also assumed available for the targeted application through prior characterization.”
The authors state this as an assumption.
Real-time machine vision applications consume the data within the time frame held by the 1 GB in-memory log.
“The real-time machine vision applications are assumed to consume the data within this time frame.”
The authors state this as an assumption.
For the short time duration the video frames are held in DRAM, the data is safe from illegal access due to the volatile nature of the memory.
“For the short time duration the video frames are held in the DRAM, the data is assumed to be safe from illegal access due to the volatile nature of the memory.”
The paper relies on this without support.
Machine vision applications at the IoT Edge do not need to support delete operations.
“Mez uses an in-memory log based storage that exploits application domain specific characteristics such as the lack of need to support delete operations, to implement a simple low latency storage.”
The paper relies on this without support.
Computational resources are constrained at the Edge due to power, space, and cost considerations.
“However, we note that computational resources are constrained at the Edge due to power, space, and cost considerations.”
The paper relies on this without support.
The lower layers of the network (TCP) provide accurate replication of the log between the IoT camera node and the Edge server.
“Instead, we rely on the lower layers of the network (TCP) for accurate replication.”
The paper relies on this without support.
Many machine vision applications support the approximate computing paradigm, where useful enough results can be obtained despite reduced quality input.
“Many machine vision applications support the approximate computing paradigm, where useful enough results can be obtained despite reduced quality input.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Evaluation describes all latencies as 95th-percentile measurements but reports medians
MinorThe evaluation states that all latencies are measured at the 95th percentile, then describes the controller results using median latency. Those are different summary statistics.
“All latencies are measured at the 95th percentile with video frames streamed from the IoT camera node to the Edge server at 5 fps.”
“With no latency control, the median latency is 260 ms due to interference from the 4 peer Edge nodes.”
DukeMTMC NATS evaluation is both ruled out and reported
MinorThe paper says NATS could not be evaluated on DukeMTMC because of its message-size limit, but the Figure 15 caption reports NATS subscriber-scaling results for DukeMTMC.
“Since the median video frame size for DukeMTMC is greater than 1 MB, we could not evaluate NATS due to its 1 MB message size limit.”
“FIGURE 15.Subscriber scaling for Mez and NATS for (a) JAAD and (b) DukeMTMC datasets with simple, medium and complex scene dynamics.”
Cites
Edge computing: Vision and challenges
Shi, W., Cao, J., Zhang, Q., Li, Y., & Xu, L. (2016) · IEEE Internet of Things Journal · doi:10.1109/jiot.2016.2579198 · Cited by 8,733 · see citing works
Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Simon, T., Wei, S.-E., & Sheikh, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.143 · Cited by 7,539 · cited 2× · see citing works
“The OpenPose project from CMU [14]–[17] is an open source real-time multi person system to detect human body, hand and facial keypoints ((x,y) coordinates of different body parts) on individual images.”
BackgroundMethodFog computing and its role in the internet of things
Bonomi, F., Milito, R., Zhu, J., & Addepalli, S. (2012) · Proceedings of the first edition of the MCC workshop on Mobile cloud computing · doi:10.1145/2342509.2342513 · Cited by 6,244 · see citing works
OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E., & Sheikh, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2929257 · Cited by 5,536 · cited 2× · see citing works
“The OpenPose project from CMU [14]–[17] is an open source real-time multi person system to detect human body, hand and facial keypoints ((x,y) coordinates of different body parts) on individual images.”
BackgroundMethodThe case for vm-based cloudlets in mobile computing
Satyanarayanan, M., Bahl, P., Caceres, R., & Davies, N. (2009) · IEEE Pervasive Computing · doi:10.1109/mprv.2009.82 · Cited by 3,660 · cited 2× · see citing works
“IoT machine vision applications are thus an ideal candidate for the Edge computing paradigm [5]–[9], where most of the processing of the video streams happen in the vicinity of the camera.”
BackgroundPerformance Measures and a Data Set for Multi-target, Multi-camera Tracking
Ristani, E., Solera, F., Zou, R., Cucchiara, R., & Tomasi, C. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-48881-3_2 · Cited by 3,104 · cited 1× · see citing works
“We use two publicly available video datasets - JAAD [19] and DukeMTMC [20] for latency characterization.”
MethodWei, S.-E., Ramakrishna, V., Kanade, T., & Sheikh, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.511 · Cited by 2,966 · see citing works
Fog and IoT: An Overview of Research Opportunities
Chiang, M., & Zhang, T. (2016) · IEEE Internet of Things Journal · doi:10.1109/jiot.2016.2584538 · Cited by 2,362 · cited 1× · see citing works
“The concept and motivation behind Edge computing are described in a number of recent publications [5]–[9], [29]–[32].”
BackgroundFog Computing: A Platform for Internet of Things and Analytics
Bonomi, F., Milito, R., Natarajan, P., & Zhu, J. (2014) · Studies in Computational Intelligence · doi:10.1007/978-3-319-05029-4_7 · Cited by 1,222 · see citing works
Hand Keypoint Detection in Single Images Using Multiview Bootstrapping
Simon, T., Joo, H., Matthews, I. A., & Sheikh, Y. A. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.494 · Cited by 1,147 · see citing works
A Survey of Techniques for Approximate Computing
Mittal, S. (2016) · ACM Computing Surveys · doi:10.1145/2893356 · Cited by 1,067 · cited 1× · see citing works
“In [38], Mittal provides a survey of approximate computing techniques.”
BackgroundIntelligent multi-camera video surveillance: A review
Wang, X. (2012) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.07.005 · Cited by 694 · cited 1× · see citing works
“Often, multiple cameras are needed to provide adequate area coverage for subject tracking and overcoming occlusions [1], [2].”
BackgroundSecurity and privacy in smart city applications: Challenges and solutions
Zhang, K., Ni, J., Yang, K., Liang, X., Ren, J., & Shen, X. S. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1600267cm · Cited by 638 · cited 1× · see citing works
“Furthermore, while many of these applications enable broader smart city initiatives, and social good, significant privacy concerns exist regarding the potential misuse of the collected video data [3].”
BackgroundFeatures for Multi-target Multi-camera Tracking and Re-identification
Ristani, E., & Tomasi, C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00632 · Cited by 556 · cited 1× · see citing works
“Often, multiple cameras are needed to provide adequate area coverage for subject tracking and overcoming occlusions [1], [2].”
BackgroundTowards wearable cognitive assistance
Ha, K., Chen, Z., Hu, W., Richter, W., Pillai, P., & Satyanarayanan, M. (2014) · Proceedings of the 12th annual international conference on Mobile systems, applications, and services · doi:10.1145/2594368.2594383 · Cited by 476 · cited 1× · see citing works
“Regarding machine vision at the Edge, in the Gabriel project [33], Ha et. al. describe a wearable cognitive assistance system where the images captured by a mobile device are processed by the Edge node to analyze what the user is seeing, and provide the user with cues as to what is in the scene…”
MethodAre They Going to Cross? A Benchmark Dataset and Baseline for Pedestrian Crosswalk Behavior
Rasouli, A., Kotseruba, I., & Tsotsos, J. K. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.33 · Cited by 436 · cited 1× · see citing works
“We use two publicly available video datasets - JAAD [19] and DukeMTMC [20] for latency characterization.”
MethodMobile-edge computing architecture: the role of mec in the internet of things
Sabella, D., Vaillant, A., Kuure, P., Rauschenbach, U., & Giust, F. (2016) · IEEE Consumer Electronics Magazine · doi:10.1109/mce.2016.2590118 · Cited by 413 · see citing works
The Case for VM-based Cloudlets in Mobile Computing
Satyanarayanan, M., Bahl, V., Cáceres, R., et al. (2009) · IEEE Pervasive Computing · doi:10.1109/mprv.2009.64 · Cited by 241 · see citing works
Chen, Z., Hu, W., Wang, J., Zhao, S., Amos, B., Wu, G., Ha, K., Elgazzar, K., Pillai, P., Klatzky, R., et al. (2017) · Proceedings of the Second ACM/IEEE Symposium on Edge Computing · doi:10.1145/3132211.3134458 · Cited by 213 · cited 1× · see citing works
“…the considerable computing power available in the Cloud, the use of Cloud computing for IoT machine vision applications is hindered by the high network latency to access a remote data center (typically hundreds of milliseconds) [4], and constraints in the upload bandwidth (typically tens of Mbps).”
Realtime Multi-Person 2D Pose Estimation using Part Affinity FieldsPreprint
Cao, Z., Simon, T., Wei, S.-E., & Sheikh, Y. A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.08050 · Cited by 142 · see citing works
Scaling Video Analytics on Constrained Edge NodesPreprint
Canel, C., Kim, T., Zhou, G., Li, C., Lim, H., Andersen, D. G., Kaminsky, M., & Dulloor, S. R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13536 · Cited by 126 · cited 1× · see citing works
“However, Canel et al. [26] suggest that a low quality H.264-encoded 1080p (1920 × 1080 pixels) stream is insufficient to perform accurate analysis for vision analytic applications such as traffic monitoring and pedestrian tracking.”
MethodHetero-Edge: Orchestration of Real-time Vision Applications on Heterogeneous Edge Clouds
Zhang, W., Li, S., Liu, L., Jia, Z., Zhang, Y., & Raychaudhuri, D. (2019) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom.2019.8737478 · Cited by 108 · cited 1× · see citing works
“In the Hetero-Edge project, Zhang et al. [36] describe a system that can efficiently orchestrate real-time vision applications on heterogeneous Edge servers.”
BackgroundBetzel, F., Khatamifard, K., Suresh, H., et al. (2018) · ACM Computing Surveys · doi:10.1145/3145812 · Cited by 102 · see citing works
The Swarm at the Edge of the Cloud
Lee, E. A., Rabaey, J. M., Hartmann, B., et al. (2014) · IEEE Design and Test · doi:10.1109/mdat.2014.2314600 · Cited by 101 · see citing works
Towards Wearable Cognitive Assistance
Ha, K., Chen, Z., Hu, W., et al. (2013) · doi:10.21236/ada591470 · Cited by 90 · see citing works
Optasia: A Relational Platform for Efficient Large-Scale Video Analytics
Lu, Y., Chowdhery, A., & Kandula, S. (2016) · ACM Symposium on Cloud Computing · doi:10.1145/2987550.2987564 · Cited by 87 · see citing works
Han, J., & Jeong, D. (2009) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2009.2024371 · Cited by 81 · cited 2× · see citing works
“The IoT camera nodes are time synchronized to the Edge server before starting the network latency measurements using the PTP network level time synchronization protocol capable of microsecond accuracy [22].”
MethodExploiting approximate computing for deep learning acceleration
Chen, C., Choi, J., Gopalakrishnan, K., Srinivasan, V., & Venkataramani, S. (2018) · Design, Automation, and Test in Europe · doi:10.23919/date.2018.8342119 · Cited by 67 · cited 1× · see citing works
“Regarding applications of approximate computing to Deep Learning, Chen et al. [39] use approximate computing to accelerate network training, while Ibrahim et al. [40] explore the use of approximate computing to realize Deep Learning networks on resource constrained embedded platforms.”
MethodFog Networking: An Overview on Research OpportunitiesPreprint
Chiang, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.00835 · Cited by 66 · see citing works
REVAMP2T: Real-Time Edge Video Analytics for Multicamera Privacy-Aware Pedestrian Tracking
Neff, C., Mendieta, M., Mohan, S., Baharani, M., Rogers, S., & Tabkhi, H. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2954804 · Cited by 62 · cited 1× · see citing works
“In [35], Neff et. al. proposes REVAMP 2 T, an IoT system that tracks pedestrians across multiple cameras by running custom-designed deep learning based vision engines at the low power Edge nodes close to the cameras.”
BackgroundSelf-citationSolving Critical Events through Mobile Edge Computing: An Approach for Smart Cities
Sapienza, M., Guardo, E., Cavallo, M., Torre, G. L., Leombruno, G., & Tomarchio, O. (2016) · IEEE International Conference on Smart Computing · doi:10.1109/smartcomp.2016.7501719 · Cited by 56 · see citing works
Reinventing Video Streaming for Distributed Vision Analytics
Pakha, C., Chowdhery, A., & Jiang, J. (2018) · USENIX conference on Hot Topics in Cloud Ccomputing · Cited by 39 · see citing works
Approximate Computing Methods for Embedded Machine Learning
Ibrahim, A., Osta, M., Alameh, M., Saleh, M., Chible, H., & Valle, M. (2018) · 2018 25th IEEE International Conference on Electronics, Circuits and Systems (ICECS) · doi:10.1109/icecs.2018.8617877 · Cited by 31 · cited 1× · see citing works
“Regarding applications of approximate computing to Deep Learning, Chen et al. [39] use approximate computing to accelerate network training, while Ibrahim et al. [40] explore the use of approximate computing to realize Deep Learning networks on resource constrained embedded platforms.”
MethodLatency Control for Distributed Machine Vision at the Edge Through Approximate Computing
George, A., & Ravindran, A. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-23374-7_2 · Cited by 8 · cited 1× · see citing works
“We choose 5 such transformation techniques (which we call tuning knobs [24]).”
MethodSelf-citationDistributed messaging system for the IoT edge
George, A. (2020) · UNC Charlotte electronic theses and dissertations · doi:10.13140/rg.2.2.31994.98247 · Cited by 5 · see citing works
Self-citation
Flagged first, then by citations
3 of the 38 references couldn’t be matched to a known paper.
Research works printed but not linked: 10
- vermesan, 2011, Internet of Things Global Technological and Societal Trends
- kreps, 2011, Kafka: A distributed messaging system for log processing, Proc of Workshop on Networking Meets Databases (NetDB), 1
- foundation, 2020, Nats Documentation
- software, 2020, RabbitMQ by Pivotal
- corporation, 2020, Jetson AGX Xavier
- foundation, 2020, Jenkins
- inc, 2020, ET Docker
- foundation, 2020, gRPC
- vision, 2020, OpenCV documentation
- foundation, 2020, Kubernetes
Cited by
Sorted by citations
Microgrid energy management and monitoring systems: A comprehensive review
J.Albarakati, A., Boujoudar, Y., Azeroual, M., Iysaouy, L. E., Kotb, H., Aljarbouh, A., Alkahtani, H. K., Mostafa, S. M., Tassaddiq, A., & Pupkov, A. (2022) · Frontiers in Energy Research · doi:10.3389/fenrg.2022.1097858 · Cited by 112 · see citing works
“It is gaining prominence to boost the intelligence and adaptability of multi-energy systems, such as smart grids, microgrids, smart homes, and hybrid electric vehicles (George and Ravindran, 2019; George and Ravindran, 2020; George et al., 2021).”
BackgroundAbaOud, M., Almuqrin, M. A., & Khan, M. F. (2023) · IEEE Access · doi:10.1109/access.2023.3301162 · Cited by 99 · see citing works
Analyzing Sentiments Regarding ChatGPT Using Novel BERT: A Machine Learning Approach
Sudheesh, R., Mujahid, M., Rustam, F., Shafique, R., Chunduri, V., Villar, M. G., Ballester, J. B., Díez, I. D. L. T., & Ashraf, I. (2023) · Information · doi:10.3390/info14090474 · Cited by 63 · see citing works
“The applications of machine and deep learning span across various domains, such as disease diagnosis [49], education [50], computer/machine vision [51,52], text classification [53], and many more.”
Multi-Agent-Based Fault Location and Cyber-Attack Detection in Distribution System
J.Albarakati, A., Azeroual, M., Boujoudar, Y., et al. (2022) · Energies · doi:10.3390/en16010224 · Cited by 63 · see citing works
Boujoudar, Y., Azeroual, M., Iysaouy, L. E., et al. (2023) · International Journal of Power Electronics and Drive Systems/International Journal of Electrical and Computer Engineering · doi:10.11591/ijece.v13i5.pp4789-4797 · Cited by 61 · see citing works
Shafique, R., Rustam, F., Choi, G. S., et al. (2023) · Cancers · doi:10.3390/cancers15030681 · Cited by 60 · see citing works
“Supervised Machine Learning Algorithms Machine learning applications in different domains such as image processing [30], computer vision [31,32], health care [33], edge computing [34], the Internet of things”
MethodEnabling All In-Edge Deep Learning: A Literature Review
Joshi, P., Hasanuzzaman, M., Thapa, C., Afli, H., & Scully, T. (2023) · IEEE Access · doi:10.1109/access.2023.3234761 · Cited by 60 · see citing works
“For example, a constrained model architecture can process between 5 to 15 frames per second (fps) with an image resolution set to 1920 × 1080 [259].”
BackgroundExploring the psychological effects of Metaverse on mental health and well-being
Din, I. U., & Almogren, A. (2023) · Information Technology & Tourism · doi:10.1007/s40558-023-00259-8 · Cited by 55 · see citing works
Electrocardiogram (ECG)-Based User Authentication Using Deep Learning Algorithms
Agrawal, V., Fard, S. M. H., Elmiligi, H., & Gebali, F. (2023) · Diagnostics · doi:10.3390/diagnostics13030439 · Cited by 54 · see citing works
“This would enable improved management through the early detection and surveillance of illness signs, thus eliminating the requirement for face-to-face interaction [6,7].”
BackgroundPrivacy-Preserving Big Data Security for IoT With Federated Learning and Cryptography
Awan, K. A., Din, I. U., Almogren, A., & Rodrigues, J. J. P. C. (2023) · IEEE Access · doi:10.1109/access.2023.3328310 · Cited by 49 · see citing works
Image Watermarking Using Least Significant Bit and Canny Edge Detection
Faheem, Z. B., Ishaq, A., Rustam, F., Díez, I. D. L. T., Aray, D. G., Vergara, M. M., & Ashraf, I. (2023) · Sensors · doi:10.3390/s23031210 · Cited by 48 · see citing works
Rukhiran, M., Wong-In, S., & Netinant, P. (2023) · IEEE Access · doi:10.1109/access.2023.3253024 · Cited by 45 · see citing works
“…the The associate editor coordinating the review of this manuscript and approving it for publication was Rebecca Strachan . accuracy and efficiency [4] of biometric recognition systems by enabling the integration of several biometric modalities, such as facial recognition and fingerprint…”
BackgroundCyber-Physical System Security Based on Human Activity Recognition through IoT Cloud Computing
Achar, S., Faruqui, N., Whaiduzzaman, M., Awajan, A. W., & Alazab, M. (2023) · Electronics · doi:10.3390/electronics12081892 · Cited by 39 · see citing works
Denial of Service Attack Classification Using Machine Learning with Multi-Features
Rustam, F., Mushtaq, M. F., Hamza, A., et al. (2022) · Electronics · doi:10.3390/electronics11223817 · Cited by 37 · see citing works
Integration of IoT and blockchain for decentralized management and ownership in the metaverse
Din, I. U., Awan, K. A., Almogren, A., & Rodrigues, J. J. P. C. (2023) · International Journal of Communication Systems · doi:10.1002/dac.5612 · Cited by 35 · see citing works
“Virtual Reality (VR) platforms like Second Life and Minecraft 26,27 provide tangible demonstrations of how the metaverse can enrich social interaction, generating shared virtual domains wherein users can engage and manipulate virtual objects akin to physical reality.”
BackgroundAutomated Battery Making Fault Classification Using Over-Sampled Image Data CNN Features
Din, N. U., Zhang, L., & Yang, Y. (2023) · Sensors · doi:10.3390/s23041927 · Cited by 31 · see citing works
A Trust-Based Secure Parking Allocation for IoT-Enabled Sustainable Smart Cities
Ali, J., & Khan, M. F. (2023) · Sustainability · doi:10.3390/su15086916 · Cited by 31 · see citing works
“The system is designed to address the challenges of high data volume, high data rate, and real-time processing requirements [28].”
BackgroundAlharbi, S. J., & Alaboodi, A. S. (2023) · Energies · doi:10.3390/en16031531 · Cited by 30 · see citing works
Enhancing AI-Human Collaborative Decision-Making in Industry 4.0 Management Practices
Alam, S., & Khan, M. F. (2024) · IEEE Access · doi:10.1109/access.2024.3449415 · Cited by 30 · see citing works
Alzahrani, A. (2023) · Sustainability · doi:10.3390/su15108020 · Cited by 26 · see citing works
IoT Adoption Model for E-Learning in Higher Education Institutes: A Case Study in Saudi Arabia
Ali, J., Madni, S. H. H., Jahangeer, M. S. I., et al. (2023) · Sustainability · doi:10.3390/su15129748 · Cited by 26 · see citing works
White Blood Cell Classification Using Texture and RGB Features of Oversampled Microscopic Images
Rustam, F., Aslam, N., Díez, I. D. L. T., et al. (2022) · Healthcare · doi:10.3390/healthcare10112230 · Cited by 24 · see citing works
SSC: The novel self-stack ensemble model for thyroid disease prediction
Ji, S. (2024) · PLoS ONE · doi:10.1371/journal.pone.0295501 · Cited by 22 · see citing works
MediTwin: A Web 3.0-Integrated Digital Twin for Secure Patient-Centric Healthcare in the Metaverse
Awan, K. A., Din, I. U., Almogren, A., & Rodrigues, J. J. P. C. (2024) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3409845 · Cited by 23 · see citing works
Ravindran, A. (2023) · IoT · doi:10.3390/iot4040021 · Cited by 27 · see citing works
Self-citationFogTrust: Fog-Integrated Multi-Leveled Trust Management Mechanism for Internet of Things
Rehman, A., Awan, K. A., Din, I. U., et al. (2023) · Technologies · doi:10.3390/technologies11010027 · Cited by 20 · see citing works
Internet of Digital Twin: Framework, Applications, and Enabling Technologies
Liu, R., Luan, T. H., Qu, Y., Xiang, Y., Gao, L., & Zhao, D. (2025) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2025.3554579 · Cited by 21 · see citing works
“Targeting on video data, George et al. [150] introduce a low latency and high accuracy method for video transmission in a multi-camera based application.”
Din, I. U., Awan, K. A., & Almogren, A. (2023) · IEEE Access · doi:10.1109/access.2023.3290911 · Cited by 19 · see citing works
“Central to this paradigm shift is the advent of Customer Centric Communication and Net-worked Control for Intelligent Cyber-Physical Transportation Systems (CNC-ICTS), which prioritize augmenting user experiences and optimizing the efficacy of transportation networks [2], [3], [4], [5].”
BackgroundRailway Track Fault Detection Using Selective MFCC Features from Acoustic Data
Rustam, F., Ishaq, A., Hashmi, M. S. A., et al. (2023) · Sensors · doi:10.3390/s23167018 · Cited by 19 · see citing works
“Machine learning models can be effective for tackling a variety of problems in such areas as computer vision applications [18,19], text mining [20], image processing [21], and the IoT [17,22], etc.”
BackgroundTrustAware-GNN: Graph-Neural-Network-Based Trust Management for IoT Anomaly Detection
Awan, K. A., Din, I. U., Almogren, A., Han, Z., & Guizani, M. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3584653 · Cited by 18 · see citing works
Alaya, B., & Sellami, L. (2023) · IEEE Access · doi:10.1109/access.2023.3264808 · Cited by 18 · see citing works
“Other metrics were considered, such as load balancing, controller capacity, communication latency between controllers, power consumption, and cost of deployment [24], [25], [26], [27].”
BackgroundQuantum and GAN-Driven Digital Twin Approach for IoT-Based Consumer Electronics Manufacturing
Din, I. U., Taj, I., Awan, K. A., et al. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3499737 · Cited by 14 · see citing works
Sarwar, A., Mushtaq, M. F., Akram, U., Rustam, F., Hamza, A., Rupapara, V., & Ullah, S. (2023) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-023-04666-x · Cited by 13 · see citing works
“Machine learning applications can be found in a variety of fields, such as the health care (Rupapara et al. 2022), machine vision (George et al. 2021), Internet of Things (IoT) (Siddiqui et al. 2021), networks security (Rustam et al. 2022, 2023), edge computing (George 2020), and many others.”
Awan, K. A., Din, I. U., Almogren, A., et al. (2023) · Electronics · doi:10.3390/electronics12153362 · Cited by 12 · see citing works
“In [30], a new distributed messaging system called ‘Mez’, was designed to process delay-sensitive multi-camera vision at the edge of IoT networks.”
MethodKumar, N. V. R., Lakshmi, N. J., Mallala, B., et al. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10560-x · Cited by 12 · see citing works
“The basic driving forces of IoT (Din et al. 2023; George et al. 2021) are the network process and specifically routing technique, which enables and drives the interconnection of devices (Miorandi et al. 2012).”
BackgroundTrackez: An IoT-Based 3D-Object Tracking From 2D Pixel Matrix Using Mez and FSL Algorithm
Faruqui, N., Kabir, M. A., Yousuf, M. A., et al. (2023) · IEEE Access · doi:10.1109/access.2023.3287496 · Cited by 12 · see citing works
“In our research, we leverage the application of Mez [14], which permits latency tolerance of up to 10x variations.”
BackgroundMethodSwarmtrust: A swarm optimization-based approach to enhance trustworthiness in smart homes
Din, I. U., Awan, K. A., Almogren, A., et al. (2023) · Physical Communication · doi:10.1016/j.phycom.2023.102064 · Cited by 11 · see citing works
Almaleh, A. (2024) · Electronics · doi:10.3390/electronics13163286 · Cited by 11 · see citing works
Cloud IaaS Optimization Using Machine Vision at the IoT Edge and the Grid Sensing Algorithm
Faruqui, N., Achar, S., Racherla, S., Dhanawat, V., Sripathi, P., Islam, M. M., Uddin, J., Othman, M. A., Samad, M. A., & Choi, K. (2024) · Sensors · doi:10.3390/s24216895 · Cited by 11 · see citing works
Awan, K. A., Din, I. U., Almogren, A., et al. (2024) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3365673 · Cited by 10 · see citing works
Awan, K. A., Din, I. U., Al-Huqail, A., et al. (2024) · Journal of Disability Research · doi:10.57197/jdr-2024-0093 · Cited by 8 · see citing works
“Despite these benefits, the diversity of these technologies raises critical data security and privacy concerns (George et al., 2021; Cheikhrouhou et al., 2023; Lopez Martinez et al., 2023; Nait Hamoud et al., 2023), given the sensitive nature of health information.”
BackgroundIntelligent Network Maintenance Modeling for Fixed Broadband Networks in Sustainable Smart Homes
Alipio, M., & Bureš, M. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3277590 · Cited by 8 · see citing works
Trust-Enhanced Lightweight Security Framework for Resource-Constrained Intelligent IoT Systems
Rehman, A. U., Awan, K. A., Alruwaili, F. F., Ara, A., Song, H. H., & Saba, T. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3514374 · Cited by 7 · see citing works
“Ensuring robust security and maintaining data integrity, confidentiality, and availability in such environments poses a formidable challenge [5], [6].”
Rehman, A., & Alharbi, O. (2024) · Computers · doi:10.3390/computers14010003 · Cited by 7 · see citing works
Sabeti, S., Shoghli, O., & Tabkhi, H. (2022) · ASCE Construction Research Congress (CRC) · doi:10.1061/9780784483961.122 · Cited by 8 · see citing works
Self-citationShakoorianfard, M., Waurich, V., Richter, C., et al. (2025) · Construction Robotics · doi:10.1007/s41693-025-00152-2 · Cited by 6 · see citing works
“George et al. (2021) address the latency issue by proposing a latency controller that adjusts the quality of the video frames based on the network quality.”
Empowering Lower Limb Disorder Identification through PoseNet and Artificial Intelligence
Siddiqui, H. U. R., Saleem, A. A., Raza, M. A., Villar, S. G., López, L. A. D., Díez, I. D. L. T., Rustam, F., & Dudley, S. (2023) · Diagnostics · doi:10.3390/diagnostics13182881 · Cited by 5 · see citing works
“These ML models are used in different real-time applications related to disease diagnosis [58], computer vision [59,60], agriculture [61], and education [62], among others.”
MethodAn Adaptive Biomimetic Ant Colony Optimization With 6G Integration for IoT Network Communication
Khan, S., Awan, K. A., Din, I. U., et al. (2023) · IEEE Access · doi:10.1109/access.2023.3310273 · Cited by 5 · see citing works
Qiu, H., Chen, Y., Chen, Z., et al. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3327490 · Cited by 4 · see citing works
“Because high network and computation latency can hinder the authentication process [40] and degrade the user experience [3].”
BackgroundAletri, O. Z., Awan, K. A., & Alqahtani, A. M. (2024) · Computers · doi:10.3390/computers14010010 · Cited by 4 · see citing works
Khan, S., Younas, N., Khan, W. J., et al. (2025) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2025.060973 · Cited by 4 · see citing works
“Unlike traditional cloud computing [5], it operates at the edge of a network [6], providing localized processing, storage, and control services to reduce latency and therefore improve real-time response [7,8].”
"PoliMOR: A Policy Engine \"Made-to-Order\" for Automated and Scalable Data Management in Lustre"
George, A., Brumgard, C., Mohr, R., et al. (2023) · doi:10.1145/3624062.3624190 · Cited by 4 · see citing works
“NATS is open source and lightweight, offers low latency (in the order of sub-milliseconds), incurs low CPU and memory overhead, and has been utilized in previous Cloud/Edge/HPC system studies [12, 15, 24].”
MethodSelf-citationOptimal selection algorithm of logistics distribution route based on machine vision
Li, H. (2022) · Journal of Computational Methods in Sciences and Engineering · doi:10.3233/jcm-226529 · Cited by 3 · see citing works
“Machine vision is an important means of obtaining the external environment [11,12].”
Real-World Computer Vision for Real-World Applications: Challenges and Directions
Tabkhi, H. (2022) · Lecture notes in networks and systems · doi:10.1007/978-3-031-16072-1_53 · Cited by 3 · see citing works
Self-citationSecure Data Analytics in Smart Grids: Preserving Privacy and Enabling Advanced Monitoring
Rele, M., Julian, A., Patil, D., et al. (2025) · Springer proceedings in energy · doi:10.1007/978-981-96-2306-8_15 · Cited by 3 · see citing works
QSTMF: Quantum-Secured Trust Management Framework for VANETs in Web 3.0 and Metaverse
Awan, K. A., Din, I. U., Almogren, A., & Rodrigues, J. J. P. C. (2025) · ACM Transactions on Autonomous and Adaptive Systems · doi:10.1145/3735672 · Cited by 3 · see citing works
“The rapid development of digital technologies has catalyzed a global change across various industries [20, 21, 43].”
SNAPS: Seamless Network-Assisted Publish-Subscribe
Chang, H., Hao, F., Kodialam, M. S., et al. (2022) · IFIP Networking Conference (IFIP Networking) · doi:10.23919/ifipnetworking55013.2022.9829774 · Cited by 3 · see citing works
“These efforts include dynamic load re-balancing among available brokers for timely message delivery [18], [19], intelligent data transformation at the edge for latency and bandwidth requirements [20], [21], and transparent client migration across brokers for optimal QoS [22].”
Trustworthy Clustering for Wireless Energy Sharing in Vehicular Systems for Consumer Applications
Awan, K. A., Din, I. U., Syed, T. A., et al. (2025) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2025.3628898 · Cited by 2 · see citing works
“By facilitating instantaneous communication between vehicles and infrastructure, 6G-enabled VANETs help mitigate traffic accidents and reduce blind spots through timely alerts and traffic updates [11], [12].”
Cybersecurity challenges and defense strategies for next-generation power systems
Azeroual, M., Moughraoui, F. Z., Iysaouy, L. E., Mimouni, A., Amrani, A. E., & Markhi, H. E. (2026) · Cyber-Physical Energy Systems · doi:10.1016/j.cpes.2025.10.002 · Cited by 4 · see citing works
Towards network-assisted publish–subscribe over wide area networks
Chang, H., Hao, F., Kodialam, M. S., et al. (2023) · Computer Networks · doi:10.1016/j.comnet.2023.109702 · Cited by 2 · see citing works
Lottery Ticket Search on Untrained Models with Applied Lottery Sample Selection
Bluteau, R., & Gras, R. (2023) · Machine Learning and Knowledge Extraction · doi:10.3390/make5020024 · Cited by 2 · see citing works
Karim, S. A. A., Mohamad, U. H., & Nohuddin, P. N. E. (2023) · Lecture notes in computer science · doi:10.1007/978-981-99-7339-2_46 · Cited by 2 · see citing works
Real-time Resource Management Mechanism for Mobile IoT Devices in 5G-enabled Edge Computing
Alqahtani, A. M. (2024) · doi:10.1109/techdev64369.2024.00023 · Cited by 2 · see citing works
“In such environments, strategic optimization of resource distribution becomes significant to minimize latency and enhance data processing speeds, which are important for improving the performance of modern time-sensitive IoT applications [5]–[7].”
Improving Network Load Using a Cloud-Edge MAS-Based Architecture for Industrial Safety Applications
Barbosa, G. B. N., Sadok, D. F. H., & Ribeiro, L. (2022) · IFIP advances in information and communication technology · doi:10.1007/978-3-031-18872-5_9 · Cited by 1 · see citing works
The multi-fault identification system of mechanical bearing based on machine vision
Zheng, G., Li, Y., Da, L., et al. (2022) · International Conference on Measuring Technology and Mechatronics Automation (ICMTMA) · doi:10.1109/icmtma54903.2022.00117 · Cited by 1 · see citing works
Alqahtani, A. M., Awan, K. A., Almaleh, A., et al. (2025) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2025.061472 · Cited by 1 · see citing works
“This lack leads to a deficient utilization of resources [16], increased latency, and high energy consumption [17,18].”
Design of intelligent campus logo guidance system based on machine vision
Yuan, Y. (2022) · International Conference on Intelligent Transportation, Big Data & Smart City (ICITBS) · doi:10.1109/icitbs55627.2022.00205
“Under the influence of campus culture, it restricts the overall image building of the University and plays an important role in promoting the all-round development of the University [4] .”
BackgroundMicro-grid Power System Monitoring Design
Al-Ani, M. A. J., & Derbel, N. (2023) · International Multi-Conference on Systems, Signals & Devices (SSD) · doi:10.1109/ssd58187.2023.10411166
Basketball Target Recognition Based on Deep Learning
Deng, W. (2024) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-981-97-1979-2_44
Analyze of LBlock and Razor Lightweight Block Cipher Resistance on Algebraic Attack
Sucipta, I. K. Y., & Susanti, B. H. (2025) · doi:10.1109/csase63707.2025.11054014
AI-Powered Budget Planning and Operational Control System for Enhanced Organizational Performance
Kumar, P. A., Sreekanthaswamy, N., Abhinandan, N., et al. (2025) · doi:10.1109/cnc68716.2025.11484522
“The researcher emphasized the efficacy of predictive analytics to the improvement of operational control and decreasing the inefficiency [21].”
- Authors
- George, A., Ravindran, A., Mendieta, M., & Tabkhi, H.
- Affiliations
- University of North Carolina at Charlotte (US)
- Venue
- IEEE Access
- Published
- 2021
- Volume
- 9
- Pages
- 21457-21473
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3127153630
- Semantic Scholar
- f3cfcc3c14d7da1ec0deb4873d149631ead8b2f7
- Cited by
- 71
- References
- 38
- Citations by year
- 2026: 1 · 2025: 10 · 2024: 13 · 2023: 36 · 2022: 11
- FWCI
- 6.96
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Science Foundation (1831795)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › IoT Networks and Protocols
- Physical Sciences › Computer Science › Computer Networks and Communications › Energy Efficient Wireless Sensor Networks
- Keywords
- publish/subscribe, IoT edge computing, pedestrian detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-09.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-09.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review