Scott Cheng

contact@chengscott.io

About

My interests lie in deep learning and high-performance computing. My current research focuses on the performance modeling of deep learning applications in heterogeneous systems.

Education

The Pennsylvania State University (PSU)
Ph.D. student in Computer Science and Engineering
Advisor: Professor Mahmut Taylan Kandemir

University Park, PA
2021 - Present

National Chiao Tung University (NCTU)
M.S. in Computer Science
Advisor: Professor I-Chen Wu

Hsinchu, Taiwan
2019 - 2021

National Tsing Hua University (NTHU)
B.S. in Computer Science
B.S. in Mathematics
Advisor: Professor Jerry Chou

Hsinchu, Taiwan
2015 - 2019
Concurrent/Dual degrees



Internship

Research Intern @ Argonne Leadership Computing Facility

  • (Ongoing)

Argonne, IL
May 2023 - Present

Research Intern @ Intel

  • (Ongoing collaboration research)
  • [ISCA'23] Optimizing CPU Performance for Recommendation Systems At-Scale.

Remote, PA
May 2022 - Dec 2022



Research & Publications

Optimizing CPU Performance for Recommendation Systems At-Scale.
ISCA 2023.

Rishabh Jain, Scott Cheng, Vishwas Kalagi, Vrushabh Sanghavi, Samvit Kaul, Meena Arunachalam, Kiwan Maeng, Adwait Jog, Anand Sivasubramaniam, Mahmut Taylan Kandemir, Chita Das.
Pennsylvania State University & Intel Corporation

2023

The Design of a MuZero Framework.
M.S. Thesis in Computer Science.

YuHsuan Cheng.
National Chiao Tung University

2021

Student Cluster Competition 2018, team NTHU: Reproducing performance of multi-physics simulations of the tsunamigenic 2004 sumatra megathrust earthquake on the Intel Skylake architecture.
Parallel Computing 90 (2019): 102569.

ShaoFu Lin, ChiChen Yang, YuHsuan Cheng, KengJui Hsu, HungHsin Chen, YuanChing Lin, and Jerry Chou
National Tsing Hua University

2019

Student cluster competition 2017, team NTHU: Reproducing vectorization of the tersoff multi-body potential on the Intel Skylake and Nvidia P100 architecture.
Parallel Computing 78 (2018): 72-78.

ChanJung Chang, YungChing Lin, YuHsuan Cheng, YuCheng Wang, LiYu Yu, TienChi Yang, and Jerry Chou
National Tsing Hua University

2018



Relevant Activities
Leadership Experience

  • System Administrator of CGI Lab, NCTU
    • Provision 40 GPU servers with PXE in three server rooms.
    • Deploy services including LDAP, NFS, VPN, Web, Mail, DNS server.

Apr 2020 - Jan 2021

  • Team Leader of Student Cluster Competition (SC'18), NTHU
    • Provision Infiniband RDMA HPC systems with power control.
    • Accelerate Horovod distributed deep learning with TensorFlow and PyTorch.

May 2018 – Nov 2018

  • Team Leader of Student Supercomputer Challenge (ASC'18), NTHU
    • Provision RDMA-enabled HPC systems with power control.
    • Achieve the highest performance in LINPACK (FP64 benchmark).
    • Optimize machine reading comprehension in the MSMARCO dataset.

Nov 2017 – May 2018

  • Team Leader of Student Cluster Competition (SC'17), NTHU
    • Provision HPC systems on the cloud with RDMA networks.
    • Accelerate 30% in Mr. Bayes using SIMD vectorization and NVIDIA GPU libraries.

Jan 2017 – Nov 2017

Jan 2017 – Sep 2017

Jun 2016 – Mar 2017

Teaching Assistant

  • Parallel Processors and Processing, PSU
2023 (1 semester)
  • Discrete Mathematics, PSU
2021 - 2022 (2 semesters)
2019 - 2020 (2 semesters)
  • Deep Learning and Practice, NCTU
2019 - 2020 (3 semesters)
  • Network Programming, NCTU

2019 (1 semester)


Honors & Awards

Studies of Applications with Deep Reinforcement Learning Technologies
Scholarship for M.S. research from the Ministry of Science and Technology, Taiwan

2019 - 2020

Hsinchu Science Park Information and Communication Talent Training Program
Scholarship for M.S. research from Hsinchu Science Park, Taiwan

2019 - 2020

Academic Achievement Award
Awarded by Department of Computer Science, National Chiao Tung University

Mar 2020

Presidential Hsing Chien Award
Awarded by National Tsing Hua University

May 2019

Academic Achievement Award * 6
Awarded by Department of Mathematics, National Tsing Hua University

2015 - 2019

Fang Xianqi Scholarship
Awarded by Chunghwa Telecom Co., Ltd

Nov 2018

First Prize, Student Supercomputer Challenge (ASC'18)
Awarded to top 20 teams of over 300 universities worldwide

Nanchang, China
May 2018

Highest Linpack, Student Supercomputer Challenge (ASC'18)
Awarded to top 1 of over 20 teams worldwide in the final

Nanchang, China
May 2018

Second Place, 2017 Student Cluster Competition (SC'17)
Awarded over 16 teams worldwide in the final

Denver, US
Nov 2017

Champion, 2017 Taiwan Student Cluster Competition (TSCC'17)
Awarded to top 1 of over 8 teams in the final
Awarded by National Center for High-performance Computing

Hsinchu, Taiwan
Sep 2017

Li Xinmin Scholarship
Awarded to top 4 students in the Department of Mathematics
Awarded by Department of Mathematics, National Tsing Hua University

Oct 2016

Open Source Software Talents Cultivation Fellowship
Fellowship for college student research from Industrial Technology Research Institute

Aug 2016

The 3rd Contest of NTHU/ITRI Open Source Incubation Program
Award of Excellence
Awarded by Department of Computer Science, National Tsing Hua University

Mar 2016