Publication detail

A Reality Check on Inference at Mobile Networks Edge

CARTAS, A. KOCOUR, M. RAMAN, A. LEONTIADIS, I. LUQUE, J. SASTRY, N. NUNEZ-MARTINEZ, L. PERINO, D. PERALES, C.

Original Title

A Reality Check on Inference at Mobile Networks Edge

Type

conference paper

Language

English

Original Abstract

Edge computing is considered a key enabler to deploy ArtificialIntelligence platforms to provide real-time applications such asAR/VR or cognitive assistance. Previous works show computingcapabilities deployed very close to the user can actually reduce theend-to-end latency of such interactive applications. Nonetheless,the main performance bottleneck remains in the machine learninginference operation. In this paper, we question some assumptionsof these works, as the network location where edge computing isdeployed, and considered software architectures within the frame-work of a couple of popular machine learning tasks. Our experimen-tal evaluation shows that after performance tuning that leveragesrecent advances in deep learning algorithms and hardware, net-work latency is now the main bottleneck on end-to-end applicationperformance. We also report that deploying computing capabilitiesat the first network node still provides latency reduction but, over-all, it is not required by all applications. Based on our findings, weoverview the requirements and sketch the design of an adaptivearchitecture for general machine learning inference across edgelocations.

Keywords

Edge computing, Artificial Intelligence

Authors

CARTAS, A.; KOCOUR, M.; RAMAN, A.; LEONTIADIS, I.; LUQUE, J.; SASTRY, N.; NUNEZ-MARTINEZ, L.; PERINO, D.; PERALES, C.

Released

25. 3. 2019

Publisher

Association for Computing Machinery

Location

Dressden

ISBN

978-1-4503-6275-7

Book

Proceedings of the 2nd ACM International Workshop on Edge Systems, Analytics and Networking (EDGESYS '19)

Pages from

54

Pages to

59

Pages count

6

URL

https://dl.acm.org/citation.cfm?doid=3301418.3313946

BibTex

@inproceedings{BUT156850,
  author="CARTAS, A. and KOCOUR, M. and RAMAN, A. and LEONTIADIS, I. and LUQUE, J. and SASTRY, N. and NUNEZ-MARTINEZ, L. and PERINO, D. and PERALES, C.",
  title="A Reality Check on Inference at Mobile Networks Edge",
  booktitle="Proceedings of the 2nd ACM International Workshop on Edge Systems, Analytics and Networking (EDGESYS '19)",
  year="2019",
  pages="54--59",
  publisher="Association for Computing Machinery",
  address="Dressden",
  doi="10.1145/3301418.3313946",
  isbn="978-1-4503-6275-7",
  url="https://dl.acm.org/citation.cfm?doid=3301418.3313946"
}