Yu Guang Wang
Associate Professor
Institute of Natural Sciences
School of Mathematical Sciences
Shanghai Jiao Tong University

Associate Professor
Artificial Intelligence Biomedicine Center
Zhangjiang Institute for Advanced Study
Shanghai Jiao Tong University

 Email:

Mail:		 yuguang.wang@sjtu.edu.cn

Institute of Natural Sciences
Shanghai Jiao Tong University
361, Build. No.6, Science Buildings
No. 800 Dongchuan Road, Minhang District
Shanghai 200240, China

Introduction

I am an Associate Professor in Institute of Natural Sciences, School of Mathematical Sciences, Department of Computer Science and Engineering, and AI Biomedicine Center of Zhangjiang Institute for Advanced Study, and Key Lab of Scientific and Engineering Computing of Minister of Education (MOE-LSC), at Shanghai Jiao Tong University. I am also an adjunct lecturer at UNSW Sydney.

My research interests lie in artificial intelligence, computational mathematics, statistics and data science. In particular, I am working on geometric deep learning, graph neural networks, applied harmonic analysis, Bayesian inference, information geometry, numerical analysis, and applications to biomedicine.

Previously, I was a research scientist at Max Planck Institute for Mathematics in Sciences, in Prof Guido Montufar's Deep Learning Theory Group. I obtained my PhD in applied mathematics from University of New South Wales under supervision of Prof Ian Sloan and Rob Womersley. I am a recipient of ICERM Semester Postdoctoral Fellowship of Brown University (2018), a long-term IPAM visitor of UCLA (2019), and long-term visitor of AI Group of Prof Pietro Lio at Univeristy of Cambridge (2022).

News

[Paper] ACMP paper joint with Yuelin, Kai, Xinliang and Shi has been accepted in ICLR 2023 as a Spotlight Paper. Also Oral Presentation in NeurIPS 2022 Workshop on New Frontiers in Graph Learning Congrats!
[Member] Jialin has been awarded Outstanding Graduate of Shanghai! She is going to pursue PhD in CS in Yale Univeristy in her next career stage. Big Congrats!
[Member] Xuebin's PhD thesis on graph neural networks with wavelet analysis has been approved by the University of Sydney! Congrats, Dr Zheng!
[Fund] Jingyao and Junnan on being awarded 2-year Zhiyuan Future Scholar Funding since 2022. Congrats!
[Media] I gave a talk at AI Forum 2022 organized by Synced on Recent Advances and Trending of Geometric Deep Learning ang Graph Neural Networks. Speech content (in Chinese)
[Member] De Yang, Ruitian, Taoqi and Shulin have joined our group. Welcome!
[Visit] I start remote visit to Prof Pietro Lio at University of Cambridge and University of Edinburgh under the support of ERC HPC-Europa3 for January to April 2022.
[Paper] Path Integral based GNN with Zheng Ma et al. has been selected in Special Issue in Journal of Statistical Mechanics: Theory and Experiment edited by Marc Mezard (Director of ENS).
[Paper] FaVeST for fast vector spherical harmonic transforms with Quoc T. Le Gia and Ming Li has been collected by ACM TOMS algorithm library CALGO.
[Member] Hanwen, Tongyi, Hao have joined our group. Welcome!

Current Research Interests

Publications

    List of publications can be found at my Google Scholar.

Book Chapter

  1. Analysis of Framelet Transforms on Simplex.
    Y. G. Wang, H. Zhu.
    Contemporary Computational Mathematics: a Celebration for the 80th Birthday of Ian Sloan. Editors: Josef Dick, Frances Y. Kuo, Henryk Wozniakowski, Publisher: Springer, 2018.

Technical Report

  1. White Paper: Geometry and Learning from Data in 3D and Beyond.
    P. Kr. Banerjee, Y. G. Wang et al.
    Technical Report, UCLA IPAM Long Program, Spring 2019.

Papers

    Submitted

  1. Dirichlet Energy Enhancement of Graph Neural Networks by Framelet Augmentation.
    J. Chen, Y. Wang, C. Bodnar, P. Lio, Y. G. Wang.

  2. How GNNs Facilitate CNNs in Mining Geometric Information from Large-Scale Medical Images.
    Y. Shen, B. Zhou, X. Xiong, R. Gao, Y. G. Wang

  3. Graph Denoising with Framelet Regularizer.
    B. Zhou, R. Li, X. Zheng, Y. G. Wang, J. Gao. Code

    2015–2022

  1. EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoning.
    C. Xu, R. T. Tan, Y. Tan, S. Chen, Y. G. Wang, X. Wang, Y. Wang. CVPR 2023.

  2. Robust Graph Representation Learning for Local Corruption Recovery.
    B. Zhou, Y. Jiang, Y. G. Wang, J. Liang, J. Gao, S. Pan, X. Zhang.
    WWW 2023 (Also in ICML 2022 Workshop on Topology, Algebra, and Geometry in Machine Learning).

  3. ACMP: Allen-Cahn Message Passing with Attractive and Repulsive Forces for Graph Neural Networks.
    Y. Wang, K. Yi, X. Liu, Y. G. Wang, S. Jin.
    ICLR 2023 (Spotlight) (Also in NeurIPS 2022 Workshop on New Frontiers in Graph Learning)

  4. Well-conditioned Spectral Transforms for Dynamic Graph Representation.
    B. Zhou, X. Liu, Y. Liu, Y. Huang, P. Lio, Y. G. Wang. Proceedings of the First Learning on Graphs Conference (LoG 2022), PMLR 180, Virtual Event, December 9–12, 2022.

  5. Lightweight Equivariant Graph Representation Learning for Protein Engineering.
    B. Zhou, O. Lv, K. Yi, X. Xiong, L. Hong, Y. G. Wang.
    NeurIPS 2022 Workshop on Machine Learning in Structral Biology

  6. Oversquashing in GNNs through the lens of information contraction and graph expansion.
    P. K. Banerjee, K. Karhadkar, Y. G. Wang, U. Alon, G. Montufar.
    58th Annual Allerton Conference on Communication, Control, and Computing 2022

  7. Numerical Computation of Triangular Complex Spherical Designs with Small Mesh Ratio.
    Y. G. Wang, R. S. Womersley, H.-T. Wu, W.-S. Yu.
    Joural of Computational and Applied Mathematics 2022

  8. How Graph Neural Networks Enhance Convolutional Neural Networks Towards Mining the Topological Structures from Histology.
    Y. Shen, B. Zhou, X. Xiong, R. Gao, Y. G. Wang.
    The 2022 ICML Workshop on Computational Biology.

  9. Approximate Equivariance SO(3) Needlet Convolution.
    K. Yi, J. Chen, Y. G. Wang, B. Zhou, P. Lio, Y. Fan, J. Hamann.
    ICML 2022 Workshop on Topology, Algebra, and Geometry in Machine Learning.

  10. Embedding graphs on Grassmann manifold.
    B. Zhou, X. Zheng, Y. G. Wang, M. Li, J. Gao.
    Neural Networks 2022.

  11. Cell Graph Neural Networks Enable Digital Staging of Tumour Microenvironment and Precisely Predict Patient Survival in Gastric Cancer.
    Y. Wang, Y. G. Wang, C. Hu, M. Li, Y. Fan, N. Otter, I. Sam, H. Gou, Y. Hu, T. Kwok, J. Zalcberg, A. Boussioutas, R. J. Daly, G. Montufar, P. Lio, D. Xu, G. I. Webb, J. Song.
    npj Precision Oncology 2022.

  12. Path Integral Based Convolution and Pooling for Graph Neural Networks.
    Z. Ma, J. Xuan, Y. G. Wang, M. Li, P. Lio.
    Journal of Statistical Mechanics: Theory and Experiment 2021.

  13. Anomaly Detection in Dynamic Graphs via Transformer.
    Y. Liu, S. Pan, Y. G. Wang, F. Xiong, L. Wang, V. C. S. Lee.
    IEEE Transactions on Knowledge and Data Engineering 2021.

  14. Weisfeiler and Lehman Go Cellular: CW Networks.
    C. Bodnar, F. Frasca, N. Otter, Y. G. Wang, P. Lio, G. Montufar, M. Bronstein.
    NeurIPS 2021.

  15. Fractional Stochastic Partial Differential Equation for Random Tangent Fields on the Sphere.
    V. V. Anh, A. Olenko, Y. G. Wang.
    Theory of Probability and Mathematical Statistics 2021.

  16. Distributed Learning via Filtered Hyperinterpolation on Manifolds.
    G. Montufar, Y. G. Wang.
    Foundations of Computational Mathematics 2021.

  17. How Framelets Enhance Graph Neural Networks.
    X. Zheng, B. Zhou, J. Gao, Y. G. Wang, P. Lio, M. Li, G. Montufar.
    ICML 2021 (Spotlight). Code

  18. Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networks.
    C. Bodnar, F. Frasca, Y. G. Wang, N. Otter, G. Montufar, P. Lio, M. Bronstein.
    ICML 2021 (Spotlight).
    (Also as a Spotlight in ICLR 2021 Workshop on GTRL).

  19. Decimated Framelet System on Graphs and Fast G-Framelet Transforms.
    X. Zheng, B. Zhou, Y. G. Wang, X. Zhuang.
    Journal of Machine Learning Research 2021. Code

  20. Grassmann Graph Embedding.
    B. Zhou, X. Zheng, Y. G. Wang, M. Li, J. Gao.
    ICLR Workshop on GTRL 2021. Code

  21. Algorithm 1018: FaVeST-Fast Vector Spherical Harmonic Transforms.
    M. Li, Q. T. Le Gia, Y. G. Wang.
    ACM Transactions on Mathematical Software 2021. Code also in CALGO (see file 1018.gz)

  22. Improve Concentration of Frequency and Time by Novel Complex Spherical Designs.
    M. Sourisseau, Y. G. Wang, R. S. Womersley, H.-T. Wu, W.-H. Yu.
    Applied and Computational Harmonic Analysis 2021. Code

  23. A New Probe of Gaussianity and Isotropy with Application to Cosmic Microwave Background Maps.
    J. Hamann, Q. T. Le Gia, I. H. Sloan, Y. G. Wang, R. S. Womersley.
    International Journal of Modern Physics C 2021. Code

  24. Distributed Filtered Hyperinterpolation For Noisy Data on the Sphere.
    S.-B. Lin, Y. G. Wang, D.-X. Zhou.
    SIAM Journal on Numerical Analysis 2021.

  25. Can Neural Networks Learning persistent homology features?
    G. Montufar, N. Otter, Y. G. Wang.
    NeurIPS Workshop on TDA and Beyond 2020.

  26. Path Integral Based Convolution and Pooling for Graph Neural Networks.
    Z. Ma, J. Xuan, Y. G. Wang, M. Li, P. Lio.
    NeurIPS 2020. Code

  27. Haar Graph Pooling.
    Y. G. Wang, M. Li, Z. Ma, G. Montufar, X. Zhuang, Y. Fan.
    ICML 2020. Code

  28. Fast Haar Transforms for Graph Neural Networks.
    M. Li, Z. Ma, Y. G. Wang, X. Zhuang.
    Neural Networks 2020.

  29. Deep Learning Based Unsupervised and Semi-supervised Classification for Keratoconus.
    N. Hallett, K. Yi, J. Dick, C. Hodge, G. Sutton, Y. G. Wang, J. You.
    IJCNN 2020.

  30. CosmoVAE: Variational Autoencoder for CMB Image Inpainting.
    K. Yi, Y. Guo, Y. Fan, J. Hamann, Y. G. Wang.
    IJCNN 2020.

  31. Tight Framelets and Fast Framelet Filter Bank Transforms on Manifolds.
    Y. G. Wang, X. Zhuang.
    Applied and Computational Harmonic Analysis, 48(1): 64–95, 2020.

  32. Isotropic Sparse Regularization for Spherical Harmonic Representations of Random Fields on the Sphere.
    Q. T. Le Gia, I. H. Sloan, R. S. Womersley, Y. G. Wang.
    Applied and Computational Harmonic Analysis, 49(1): 257–278, 2020.

  33. Tight framelets on graphs for multiscale data analysis.
    Y. G. Wang, X. Zhuang.
    Wavelets and Sparsity XVIII, SPIE Proc., pp. 11 138–11, 2019.

  34. PAN: Path Integral Based Convolution for Deep Graph Neural Networks.
    Z. Ma, M. Li, Y. G. Wang.
    ICML Workshop on Learning and Reasoning with Graph-Structured Representations (Oral) 2019. Code

  35. On Approximation of Fractional Stochastic Partical Differential Equations on the Sphere.
    V. V. Anh, P. Broadbridge, A. Olenko, Y. G. Wang.
    Stochastic Environmental Research and Risk Assessment 2018.

  36. Riemann Localisation on the Sphere.
    Y. G. Wang, I. H. Sloan, R. S. Womersley.
    Journal of Fourier Analysis and Applications, 24(1): 141–183, 2018.

  37. Random Point Sets on the Sphere — Hole Radii, Covering, and Separation.
    J. S. Brauchart, E. B. Saff, I. H. Sloan, Y. G. Wang, R. S. Womersley.
    Experimental Mathematics, 27(1): 62–81, 2018.

  38. Fully Discrete Needlet Approximation on the Sphere.
    Y. G. Wang, Quoc T. Le Gia, I. H. Sloan, R. S. Womersley.
    Applied and Computational Harmonic Analysis, 43: 292–316, 2017. Code

  39. Needlet Approximation for Isotropic Random Fields on the Sphere.
    Y. G. Wang, Quoc T. Le Gia, I. H. Sloan, R. S. Womersley.
    Journal of Approximation Theory, 216: 86–116, 2017.

  40. Filtered Polynomial Approximation on the Sphere.
    Y. G. Wang.
    Bulletin of the Australian Mathematical Society, 93(01): 162–163, 2016.

  41. An Iterative Learning Algorithm for Feedforward Neural Networks with Random Weights.
    F. Cao, D. Wang, H. Zhu, Y. G. Wang.
    Information Sciences, 328: 546–557, 2016.

  42. Covering of Spheres by Spherical Caps and Worst-case Error for Equal Weight Cubature in Sobolev Spaces.
    J. S. Brauchart, J. Dick, E. B. Saff, I. H. Sloan, YG. Wang, R. S. Womersley.
    Journal of Mathematical Analysis and Applications, 431(2):782–811, 2015.

    43. Before 2015

  43. Approximation by Semigroup of Spherical Operators.
    Y. G. Wang, F. Cao.
    Frontiers of Mathematics in China, 9(2):387–416, 2014.

  44. A Modified Extreme Learning Machine with Sigmoidal Activation Functions.
    Z. Chen, H. Zhu, Y. G. Wang.
    Neural Computing and Applications, 22(3-4):541–550, 2013. Code

  45. Optimization Approximation Solution for Regression Problem Based on Extreme Learning Machine.
    Y. Yuan, Y. G. Wang, F. Cao.
    Neurocomputing, 74(16):2475–2482, 2011. Code

  46. A Study on Effectiveness of Extreme Learning Machine.
    Y. G. Wang, F. Cao, Y. Yuan.
    Neurocomputing, 74(16):2483–2490, 2011. Code

  47. Approximation by Boolean Sums of Jackson Operators on the Sphere.
    Y. G. Wang, F. Cao.
    Journal of Computational Analysis and Applications, 13(5):830–842, 2011.

  48. The Direct and Converse Inequalities for Jackson-type Operators on Spherical Cap.
    Y. G. Wang, F. Cao.
    Journal of Inequalities and Applications, Art. ID 205298, 16 pages, 2009.

Group Members

I am hiring PhD/Masters students in Graph Neural Networks and Geometric Deep Learning: model, algorithm, theory and applications, from mathematics and computer science. Postgraduate candidates can jointly affiliate with Institute of Natural Sciences (INS) or Zhangjiang Institute for Advanced Study (ZIAS), Shanghai Jiao Tong University. ZIAS will focus on AI for Biomedicine (using GNN/GDL for Drug Discovery, Protein Design, etc.)

Researcher
Bingxin Zhou, 2018-, University of Sydney Business Analytics, research on graph neural networks, manifold learning
 

Master
Xinye Xiong, Shanghai Jiao Tong University, INS & Stats, research on graph neural networks, computer vision, medical image, 2021 (joint with Prof Lin Liu)
 

Undergraduate
Jingyao Zhang, Shanghai Jiao Tong University, Zhiyuan College, research on dynamic graphs, medical imaging, 2021 
Junnan Li, Shanghai Jiao Tong University, Maths, research on dynamic graphs, 2021 
Taoqi Ren, Shanghai Jiao Tong University, Zhiyuan College, research on graph neural networks, harmonic analysis, 2022 

PhD
Outongyi Lv, 2022-, Shanghai Jiao Tong University, INS & Math, research on reinforcement learning, deep learning, graph neural networks 
Hanwen Liu, 2022-, Shanghai Jiao Tong University, INS & Math, research on computational mathematics, deep learning, graph neural networks 
Hao Chen, 2022-, Shanghai Jiao Tong University, INS & Stats, research on mathematical and statistical theory for geometric deep Learning  (joint with Prof Lin Liu and Prof Huan Xiong)
Chutian Zhang, 2021-, Shanghai Jiao Tong University, INS & Math, research on graph neural networks, geometric deep learning 
Yuelin Wang, 2020-, Shanghai Jiao Tong University, research on theory and algorithms for geometric deep learning (joint with Prof Shi Jin)
Kai Yi, 2020-, UNSW Statistics and Data Science, research on deep Bayesian learning, graph neural networks, (joint with A/Prof Yanan Fan, Dr Jan Hamann)
 

Alumni
Xinliang Liu (Postdoc, now at KAUST) 
Yuehua Liu (Postdoc, now at Philips Research) 
Xuebin Zheng (PhD, University of Sydney, now at EcoPlants) 
Jialin Chen (Honors, Shanghai Jiao Tong University, now at Yale University in CS) 
Yiqing Shen (Honors, Shanghai Jiao Tong University, now at Johns Hopkins University in CS) 

Recent and Upcoming Events

Regular Seminars

  •  AI Group Seminar, University of Cambridge, 2023.
  •  Distinguished Lectures and INS Colloquia, INS, SJTU, Online, 2022.
  •  AI + Math Colloquia, INS, SJTU, Online, 2022.
  •  Deep Learning Theory & Math Machine Learning Seminar, MPI MIS + UCLA, Online, 2022.
  •  Machine Learning + X Seminars, Brown University, Online, 2022.
  •  M2D2: Molecular Modeling And Drug Discovery, Mila & Valence, Online, 2022.

Workshop and Conference

  •  ICIAM Minisymposium on Mathematics of Geometric Deep Learning, Waseda University, 20-25 August 2023.
  •  Foundations of Computational Mathematics (FoCM), Sorbonne University, 12-21 June 2023.
  •  14th International Conference on Monte Carlo Methods and Applications, Sorbonne University, 26-30 June 2023.
  •  International Conference on Applied Mathematics, City University of Hong Kong, 30 May - 3 June 2023.
  •  Cambridge AI Research Group Talks, University of Cambridge, 22 October 2022.
  •  Machine Learning + X Seminars, Online, Brown University, 7 January 2022.
  •  Workshop on Combinatorics and Information Transfer, Shanghai Jiao Tong University, 27-28 December 2021.
  •  ELLIS Machine Learning for Molecule Discovery Workshop, Online, ELLIS unit Cambridge & ELLIS unit Linz, 13 December 2021.
  •  NeurIPS MeetUp China, Shanghai, 11 December 2021.
  •  NeurIPS, Online, 6-14 December 2021.
  •  Deep learning and partial differential equations, Online, INI, Cambridge, 15-19 November 2021.
  •  Geometry & Learning from Data Workshop, Online, BIRS, 24-29 October 2021.
  •  International Conference on Computational Harmonic Analysis, Online, Cambridge & Online, 13-17 September 2021.
  •  Theory of Deep Learning, Isaac Newton Institute, Cambridge & Online, 9-13 August 2021.
  •  Conference on Mathematics of Machine Learning, Bielefeld University & Online , 4-7 August 2021.
  •  TopoNets 2021 - Networks beyond pairwise interactions, Online , 30 June 2021.
  •  AI Group Seminar, University of Cambridge, Online, 11 May 2021.
  •  ICLR Workshop on Geometric and Topological Representation Learning, Online, 7 May 2021.
  •  ICLR'21, Online, 3-7 May 2021.
  •  AIM: Artificial Intelligence and Mathematics, CNR IAC (National Research Council of Italy), Online, 4 May 2021.
  •  Topological Data Analysis, Online, 26-30 April 2021.
  •  Business Analytics Seminar, University of Sydney, Online, 30 Apr 2021.

Service

Guest Associate Editor for Special Issue Deep Neural Networks for Graphs: Theory, Models, Algorithms and Applications in IEEE Transactions on Neural Networks and Learning Systems (Top AI Journal). Call for Papers!

Review Editor for the journal Frontiers in Applied Mathematics and Statistics.

Reviewer for ICML'20 (Top Reviewer), ICML'20-23, NeurIPS'21-23, NeurIPS'21, ICLR'21-23, IJCAI'21-23.

Organiser for Collaborate@ICERM on Geometry of Data and Networks, 2019 joint with Joan Bruna (NYU), Zheng Ma (Princeton), Guido Montúfar (UCLA), Nina Otter (UCLA).

Organiser for Minisymposium on Harmonic Analysis for Graph Signal Processing and Deep Learning Applications in SIAM Conference on Mathematics of Data Science 2020 (MDS20, postponed to May 2021) joint with Xiaosheng Zhuang (CityU HK).

Teaching

I am lecturing the following courses in 2021-2022.

    2021 Fall, Computational Mathematics (Graduate)
    2022 Spring, Deep Learning (Applied Statistics Graduate)
    2022 Spring, Optimization (Graduate)

I was a class tutor in UNSW for following courses.

    Semester 3 2019, MATH3101/5305 Computational Mathematics (Numerical Methods for PDEs)
    Semester 2 2018, MATH2089 Numerical Methods and Statistics
    Semester 1 2015, MATH1131 Mathematics 1A
    Semester 2 2014, MATH1231 Mathematics 1B, MATH1241 Higher Mathematics 1B, MATH2019 Engineering Mathematics 2E

Masters

    Yi Guo, 2018-2019, UNSW, thesis title: Cosmo-Encoder: A Bayesian deep learning approach for cosmic microwave background inpainting
    Kai Yi, 2018-2019 UNSW, thesis title: Variational autoencoder for cosmic microwave background image inpainting (Current: PhD in UNSW)

Honors and Awards

    ICML Top Reviewer, 2020
    ICERM Postdoctoral Fellowship, Brown University, 2018
    University International Postgraduate Award, UNSW, 2011-2015

Funding

I am grateful for the financial support of the following institutions:

    Institute of Natural Sciences, Shanghai Jiao Tong University
    AI Biomedicine Center, Zhangjiang Institute for Advanced Study
    Huawei Central Research Institute
    Explore X, Shanghai Jiao Tong University
    Ministry of Education Key Lab in Scientific and Engineering Computing
    Shanghai National Center for Applied Mathematics
    European Research Council

Copyright @ 2022 Yu Guang Wang Top