Research and implementation of the affinity scheduling algorithm of logical data block in big data analysis system

Fei Zou

doi:10.1117/12.2642638

28 July 2022 Research and implementation of the affinity scheduling algorithm of logical data block in big data analysis system

Fei Zou

Author Affiliations +

Proceedings Volume 12303, International Conference on Cloud Computing, Internet of Things, and Computer Applications (CICA 2022); 123030B (2022) https://doi.org/10.1117/12.2642638
Event: International Conference on Cloud Computing, Internet of Things, and Computer Applications, 2022, Luoyang, China

Abstract

This article analyzes the common technologies of logical data block of big data analysis system, including big data analysis technology, HBase structure, Spark structure, TPCx-BB structure , combined with the application advantages and application points of logical data block affinity scheduling algorithm , by studying the implementation of hot spot determination rules, JLQ scheduling algorithm, LAS scheduling algorithm, etc., the purpose is to give full play to the application advantages of affinity scheduling algorithm and improve the application value of system logic data blocks.

Citation Download Citation

Fei Zou "Research and implementation of the affinity scheduling algorithm of logical data block in big data analysis system", Proc. SPIE 12303, International Conference on Cloud Computing, Internet of Things, and Computer Applications (CICA 2022), 123030B (28 July 2022); https://doi.org/10.1117/12.2642638

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available