An Overview on Generative AI at Scale with Edge-Cloud Computing
원문 초록
As a specific category of artificial intelligence (AI), generative artificial intelligence (GenAI) generates new content that resembles what is created by humans. The rapid development of GenAI systems has created a huge amount of new data on the Internet, posing new challenges to current computing and communication frameworks. Currently, GenAI services rely on the traditional cloud computing framework due to the need for large computation resources. However, such services will encounter high latency because of data transmission and a high volume of requests. On the other hand, edge-cloud computing can provide adequate computation power and low latency at the same time through the collaboration between edges and the cloud. Thus, it is attractive to build GenAI systems at scale by leveraging the edge-cloud computing paradigm. In this overview paper, we review recent developments in GenAI and edge-cloud computing, respectively. Then, we use two exemplary GenAI applications to discuss technical challenges in scaling up their solutions using edge-cloud collaborative systems. Finally, we list design considerations for training and deploying GenAI systems at scale and point out future research directions.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
GATES: Cost-aware Dynamic Workflow Scheduling via Graph Attention Networks and Evolution Strategy
Enhanced Outsourced and Secure Inference for Tall Sparse Decision Trees
InTec: integrated things-edge computing: a framework for distributing machine learning pipelines in edge AI systems
Persistence of Backdoor-based Watermarks for Neural Networks: A Comprehensive Evaluation
Toward Intelligent and Secure Cloud: Large Language Model Empowered Proactive Defense
All-in-one foundational models learning across quantum chemical levels
토론
이 논문과 연결된 포럼 글이 아직 없습니다.