报告题目：Deep Learning Modes
报告时间：2022年11月6日上午9：00（上）
2022年11月8日上午9：00（下）
线上报告方式：腾讯会议
会议码：718-5064-6713
线下报告地点：吉林大学中心校区王湘浩楼A521
报告人：许东 教授
报告人简介：
Dong Xu is Curators’ Distinguished Professor in the Department of Electrical Engineering and Computer Science, with appointments in the Christopher S. Bond Life Sciences Center and the Informatics Institute at the University of Missouri-Columbia. He obtained his Ph.D. from the University of Illinois, Urbana-Champaign in 1995 and did two years of postdoctoral work at the US National Cancer Institute. He was a Staff Scientist at Oak Ridge National Laboratory until 2003 before joining the University of Missouri, where he served as Department Chair of Computer Science during 2007-2016 and Director of Information Technology Program during 2017-2020. Over the past 30 years, he has conducted research in many areas of computational biology and bioinformatics, including single-cell data analysis, protein structure prediction and modeling, protein post-translational modifications, protein localization prediction, computational systems biology, biological information systems, and bioinformatics applications in human, microbes, and plants. His research since 2012 has focused on the interface between bioinformatics and deep learning. He has published more than 400 papers with more than 21,000 citations and an H-index of 74, according to Google Scholar. He was elected to the rank of American Association for the Advancement of Science (AAAS) Fellow in 2015 and American Institute for Medical and Biological Engineering (AIMBE) Fellow in 2020.
报告内容简介：
Deep learning models often require various settings and customizations to handle many use cases (e.g., no or few training labels) and application requirements (e.g., user privacy and models with low computational costs). For this purpose, a number of deep learning modes are established. In this talk, knowledge distillation will be introduced, especially the teacher-student model to train a small model to mimic a pre-trained, larger model (or ensemble of models), together with many examples, e.g., distilled BERT models. Methods for zero-shot, one-shot, and few-shot learning, including Siamese network will be explained. End-to-end learning and online learning will be covered, as well as their system implementation. Major techniques for active learning and federated learning will also be summarized. These methods help students become experts in the deep learning field.
主办单位：吉林大学计算机科学与技术学院
吉林大学软件学院
吉林大学计算机科学技术研究所
符号计算与知识工程教育部重点实验室
仿真技术教育部重点实验室
网络技术及应用软件教育部工程研究中心
吉林大学国家级计算机实验教学示范中心
