Author: xixi

Editor: Sanyang, Li Baozhu

The 2023 Meet TVM · Year-end party was successfully concluded in Shanghai on December 16. This meetup not only invited 4 AI compiler experts to bring wonderful sharing to everyone, but also added a roundtable discussion session to discuss the innovations and challenges of machine learning systems in the era of large models with everyone from a more diverse perspective.

December 16 2023 Meet TVM · The year-end party was successfully held at the Shanghai Entrepreneurs Public Training Base! Although the temperature in Shanghai dropped sharply, it did not reduce the enthusiasm of community partners to participate.More than 140 participants from academia and industry came from all over the world to join this AI compiler party full of Christmas atmosphere.

As the final battle of 2023 Meet TVM,We are honored to invite 6 AI compiler experts from Shanghai Jiao Tong University, OctoML, Meituan, ByteDance, OpenBayes Bayesian Computing and NIO to give us wonderful speeches and roundtable discussions.

2023 Meet TVM · The year-end party brought a perfect end to the AI compiler journey in 2023. In 2024, we look forward to continuing to work together with you to jointly open a new chapter in the field of AI compilers.

01 Event content review

The following is a brief introduction to the event and a video review of the event.

Follow the WeChat public account "HyperAI 超神经元", reply to the keyword "TVM year-end party" in the background, and get the complete PPT of the guests.

📢 A small preview: The content of the roundtable meeting will be shared in the form of a text transcript next week, so stay tuned~

Share topic:Deep Dive into TVM Unity
Contents:After more than a year of iteration and upgrading, TVM Unity is expected to be merged into the main branch of Apache TVM in the near future, and will then become the main compilation process of Apache TVM.This sharing will introduce the default compilation process of TVM Unity, the difference from the existing TVM, and how to migrate the existing workflow to Unity.
Share Video:

https://www.bilibili.com/video/BV1vb4y1V75R/?spm_id_from=333.337.search-card.all.click

Share topic:Slim-LM: Unified Compilation Framework for Agile Development
Contents:As MLC LLM and TVM Unity gradually develop, more and more users want to try to use TVM to deploy their own models. However, there are many challenges in how to use TVM flexibly and efficiently to build and compile models.
Based on this demand, the TVM community recently launched a new framework Slim-LM to simplify the TVM construction and model compilation process.Contains three major features:

1. PyTorch-style code definition TVM model

2. Simple and efficient compilation tools

3. Unified Quantization Algorithm Framework

Share Video:

https://www.bilibili.com/video/BV1dC4y1S7Gj/?spm_id_from=333.337.search-card.all.click

Share topic:Compilation optimization practice based on TVM
Contents:With the iterative development of AI compilers, their usability and ease of use have been greatly improved.As one of the representatives of AI compilers, how to maximize the role of TVM, improve its own shortcomings, and implement it on a large scale in business scenarios such as search, broadcast, and promotion is an important issue.This sharing will mainly introduce from the above perspectives.
Share Video:

https://www.bilibili.com/video/BV1Ja4y1k7ba/?spm_id_from=333.337.search-card.all.click

Share topic:Towards seamless model compilation integration
Contents:Model compilation is becoming increasingly important in AI acceleration.However, adopting model compilation for production models in IT companies is not a simple matter. The main burdens include models from different domains, frameworks, or formats, transitioning from existing libraries, and adopting new ASICs. To address these issues, ByteIR was developed to improve the productivity of model compilation. ByteIR is built on top of OpenXLA and the LLVM/MLIR compiler infrastructure.It includes front-end, compiler, and runtime components, each of which solves different problems. These three components can work together or choose to work independently to meet different business needs.
Share Video:

https://www.bilibili.com/video/BV1Nu4y1K7Af/?spm_id_from=333.337.search-card.all.click

02 2024 Meet TVM · Stay tuned

From Q1 to Q4 of 2023, we successfully held 4 offline meetups in Shanghai, Beijing, and Shenzhen.I am very happy to be able to gather engineers who are interested in AI compilers in different cities and provide a platform for learning and communication. In 2024, we will continue to develop the TVM city map.We sincerely invite all corporate and community partners to participate in co-creation in various forms, whether it is recommending lecturers or providing venues and tea breaks, we welcome them all.Let's work together to create the most active AI compiler community in China! Finally, let's share a group photo of the scene❤️

From Q1 to Q4 of 2023, we successfully held 4 offline meetups in Shanghai, Beijing, and Shenzhen.I am very happy to be able to gather engineers who are interested in AI compilers in different cities and provide a platform for learning and communication. In 2024, we will continue to develop the TVM city map.We sincerely invite all corporate and community partners to participate in co-creation in various forms, whether it is recommending lecturers or providing venues and tea breaks, we welcome them all.Let's work together to create the most active AI compiler community in China! Finally, let's share a group photo of the scene❤️

The full transcript of the roundtable session will be published on the official account "HyperAI Super Neural Network" next week.At that time, you can check out the wonderful speeches of the five guests at the roundtable forum on "Innovations and Challenges of Machine Learning Systems in the Era of Big Models".

You can also note "TVM Year-End Party", scan the QR code to join the event group, and get the latest event information~

03 Organizers and partners

As the organizer of this event, the MLC.AI community was established in June 2022. Led by Chen Tianqi, the main inventor of Apache TVM and a well-known young scholar in the field of machine learning, the team launched the MLC online course, which systematically introduced the key elements and core concepts of machine learning compilation.

In November 2022, with the joint efforts of MLC.AI community volunteers, the first complete TVM Chinese documentation was launched and successfully hosted on the HyperAI official website, further providing domestic developers interested in machine learning compilation with the basic settings for accessing and learning a new technology - documentation.
MLC Online Courses:https://mlc.ai/TVM Chinese Documentation:https://tvm.hyper.ai/

HyperAI is China's leading artificial intelligence and high-performance computing community, dedicated to providing high-quality public resources in the field of data science to domestic developers.So far, it has provided domestic download nodes for more than 1,200 public data sets, supported 300+ artificial intelligence and high-performance computing related term queries, and now has included hundreds of industry terms and cases, launched thousands of public data sets and tutorials including large models, and hosted the complete TVM Chinese documentation.
Visit the official website:https://hyper.ai/

OpenBayes Bayesian Computing is a leading high-performance computing service provider in ChinaBy grafting classic software ecosystems and machine learning models onto new-generation heterogeneous chips, it provides industrial enterprises and university scientific research with faster and easier-to-use data science computing products. Its products have been adopted by dozens of large industrial scenarios or leading scientific research institutes.
Visit the official website:https://openbayes.com/

Centimeter Space (Xiamen) isChina Merchants GroupIts professional innovation park management company operates the "CM Space" professional incubator in Xiamen. Rooted in the southeast coast, relying on the three main business advantages of China Merchants Group in transportation, urban and park comprehensive development and finance, it focuses on providing artificial intelligence startups with the most urgently needed application scenarios, model verification, seed-stage customers and other resource support in the early stages of development, and assists artificial intelligence companies in efficient incubation.

superiorHaiyun BaseShanghai Cloud Computing Innovation Base and Shanghai Big Data Innovation Base are national professional incubators that started early in China, promoting the development of the cloud computing industry from 0 to 1. With the model of fund + base + platform, with the digital economy industry as the core, focusing on cloud computing, cloud native, big data and artificial intelligence, digital healthcare and other sub-sectors, it has gathered and incubated nearly a thousand outstanding companies at home and abroad. By connecting the four ecosystems of technology, users, capital, and services, it continues to hold "Scenario Innovation Lab" and "Digital Economy Listing Preparation Camp" to build a digital economy.Industry Accelerator.

Homevalley - a one-stop cross-border service platform for global enterprises, is committed to building a market-oriented enterprise service platform with entrepreneurial incubation bases, Homevalley talents, Homevalley enterprise services, and Homevalley cultural communication as its core content. Linking overseas think tanks and market resources in North America, Europe, and Asia, it provides services such as industrial park and incubation base operations, entrepreneurial training, corporate consulting services, investment and financing, overseas talent return development, and global innovation and entrepreneurship activities, while helping Chinese entrepreneurial companies go overseas. Homevalley aims to discover talents, cultivate talents, and achieve talents, helping outstanding young talents realize their dreams and forming a place of home for overseas returnees to start businesses and cultivate talents.