NeurIPS 2022

Timezone: »

Expo Workshop

Graph Neural Networks in Tensorflow: A Practical Guide

Bryan Perozzi · Sami A Abu-El-Haija · Neslihan Bulut · Brandon Mayer

Mon Nov 28 07:30 AM -- 10:25 AM (PST) @ Room 292

Event URL: https://github.com/tensorflow/gnn/blob/main/examples/tutorials/neurips_2022/README.md »

Tutorial Website is here!

Google Meet Link: https://meet.google.com/yko-cpuk-czg

Slides: https://drive.google.com/file/d/1ECcnRgJqjmj7hlegYuPdscLCUw7YJc7G/view?usp=sharing

Motivation

Graphs are general data structures that can represent information from a variety of domains (social, biomedical, online transactions, and many more). Graph Neural Networks (GNNs) are an exciting way to use graph structured data inside neural network models that have recently exploded in popularity. However, implementing GNNs and running GNNs on large (and complex) datasets still raises a number of challenges for machine learning platforms.

Goals

The main goal of this tutorial is to help practitioners and researchers to implement GNNs in a TensorFlow setting. Specifically, the tutorial will be mostly hands-on, and will walk the audience through a process of running existing GNNs on heterogeneous graph data, and a tour of how to implement new GNN models. The hands-on portion of the tutorial will be based on TF-GNN, a new framework that we open-sourced.

Learning objectives
1. Conceptual understanding of Graph Neural Networks (GNNs).
2. Hands-on: How to train and evaluate GNNs in TensorFlow, using TF-GNN.
3. Understanding of message passing building blocks for crafting advanced GNN architectures.
4. Hands-on: How to implement custom models inside TF-GNN.
5. Know how to run TF-GNN models at scale, using cloud environments.
6. Hands-on: Run TF-GNN at scale on large graphs.

Structure

This tutorial consists of 3 lectures, paired with 3 python notebooks, which cover different aspects of working with TF-GNN.

- 9:30 AM. Basics of TF-GNN
- 10:30 AM. Modeling with TF-GNN
- 11:30 AM. Scaling GNNs w/ TF-GNN

Material

ALL Presentation Slides

The notebooks (and recordings eventually) can be found on the tutorial website

Additional Resources

If you're interested in learning more about GNNs or TF-GNN, we recommend the following resources:

- Our paper TF-GNN: Graph Neural Networks in TensorFlow, details the API design and background of the library.
- The in-depth notebook OGBN-MAG end-to-end with TF-GNN offers a deep dive on building heterogeneous graph models using TF-GNN.

Mon 7:30 a.m. - 7:40 a.m.	Welcome ( Introduction )	Bryan Perozzi 🔗
Mon 7:40 a.m. - 8:00 a.m.	GNN Basics ( Talk ) A brief overview of GNNs and motivation for TF-GNN.	Sami A Abu-El-Haija 🔗
Mon 8:00 a.m. - 8:20 a.m.	TF-GNN Basics (Hands on) ( Demonstration ) Overview of running TF-GNN models on small scale, in-memory datasets.	Sami A Abu-El-Haija 🔗
Mon 8:20 a.m. - 8:30 a.m.	Break	🔗
Mon 8:30 a.m. - 8:50 a.m.	TF-GNN Modeling ( Talk ) A more detailed dive into data representation and modeling primitives available in TF-GNN.	Neslihan Bulut 🔗
Mon 8:50 a.m. - 9:20 a.m.	TF-GNN Modeling (Hands on) ( Demonstration ) Hands-on walk through a notebook illustrating how to use and create a TF-GNN model.	Neslihan Bulut 🔗
Mon 9:20 a.m. - 9:30 a.m.	Break	🔗
Mon 9:30 a.m. - 9:50 a.m.	Running TF-GNN at Scale ( Talk ) Covers how to run TF-GNN at scale, covering: 1) Common ML system architectures 2) Batch architectures for scaling Graph Neural Networks 3) Introduction to Apache Beam for Scalable Graph Sub-Sampling	Brandon Mayer 🔗
Mon 9:50 a.m. - 10:20 a.m.	Running TF-GNN at Scale (Hands on) ( Demonstration ) Hands-on walk through a notebook illustrating using TF-GNN with cloud computing. Covers distributed sampling, and model training with VertexAI.	Brandon Mayer 🔗
Mon 10:20 a.m. - 10:25 a.m.	Closing	Anton Tsitsulin 🔗

Author Information

Bryan Perozzi (Google Research)

Sami A Abu-El-Haija (Google Research)

Neslihan Bulut (Google)

Brandon Mayer (Google)

More from the Same Authors