Summer school on
Deep Learning and
Bayesian Methods

August 20–25, 2019, Moscow, Russia

Organized by

Samsung AI Center in Moscow


Bayesian Methods Research Group

Summer School Scope & Goals

At Deep|Bayes summer school, we will discuss how Bayesian Methods can be combined with Deep Learning and lead to better results in machine learning applications. Recent research has proven that the use of Bayesian approach can be beneficial in various ways. School participants will learn methods and techniques that are crucial for understanding current research in machine learning. They will also have hands-on experience with using probabilistic modeling to build neural generative and discriminative models, learn modern stochastic optimization methods and regularization techniques for neural networks, and master the ways to reason about the uncertainty about the weight of the neural networks and their predictions. Lectures will be followed by practical sessions.

Audience

Our summer school is intended for:

  • Undergraduate students (preferably those who completed at least 2 years of study) and graduate students with strong mathematical background and decent knowledge of machine learning including deep learning
  • Researchers and industry professionals working in machine learning or related areas, willing to expand their knowledge and skills

Participation prerequisites

  1. Strong knowledge of machine learning and familiarity with deep learning.
  2. Mathematics: proficiency in linear algebra and probability theory is highly desirable.
  3. Programming: Python with PyTorch and NumPy.
  4. Once again English will be the language of Deep|Bayes 2019 summer school, so participants are expected to be comfortable with technical English.

What will I learn at the Deep|Bayes school?

  • Why are Bayesian methods useful (in machine learning and everyday life)? What is randomness, indeed?
  • Latent Variable Models. How to train a model able to discover patterns unknown before training?
  • Scalable probabilistic models. Why can it be useful to turn a probabilistic inference problem into an optimization problem?
  • How to train an infinite ensemble of neural networks using the same amount of memory?
  • Stochastic optimization. How to optimize a function faster than computing its value at one point?
  • How to apply well-established probabilistic modeling tools such as MCMC and Gaussian processes to modern large-scale problems?

Our goal is to show that using the Bayesian approach in deep learning models can expand the range of their applicability and improve their performance. Although there are many different problem settings in machine learning, probabilistic inference for Bayesian networks can be performed in a similar way for most of them. Do you want to learn more about these methods? Come to our summer school!

Preliminary Dates

  1. February 16: Applications open
  2. April 15, 23:59 Moscow Time (GMT+3): Applications close
  3. May 1: Acceptance notification
  4. August 20–25: Summer School

Materials

The school is over, but look what've got here:

Videos Slides Assignments

Program

A pdf version of the school's program can be found here.

People

Most of our lecturers and tutors are members of the Bayesian Methods Research Group and researchers from the world’s leading research centers. Many school lecturers have published at top international machine learning conferences such as NIPS, ICML, ICCV, CVPR, ICLR, AISTATS, and others. Today, the Bayesian Methods Research group is one of the leading machine learning research groups in Russia. Members of the group have developed a range of university courses in Bayesian Methods, Deep Learning, Optimization and Probabilistic Graphical Models and have substantial teaching experience.

Invited Speakers

Novi Quadrianto
Higher School of Economics, University of Sussex
Francisco Jesus Rodriguez Ruiz
Columbia University, University of Cambridge
Sergey Bartunov
DeepMind
Andrey Malinin
University of Cambridge

Lecturers

Dmitry Vetrov
Research Professor, Higher School of Economics
Dmitry Kropotov
Researcher, Lomonosov Moscow State University
Evgeny Burnaev
Associate Professor, Skoltech
Egor Zakharov
Engineer, Samsung AI Center, Moscow
Kirill Neklyudov
Research Fellow, Higher School of Economics
Dmitry Molchanov
Research Fellow, Higher School of Economics
Arsenii Ashukha
Research Scientist, Samsung AI Center
Artem Sobolev
Research Scientist, Samsung AI Center

Teaching Fellows

Kirill Struminsky
PhD student, Higher School of Economics
Ekaterina Lobacheva
Research Fellow, Higher School of Economics
Arsenii Ashukha
Research Scientist, Samsung AI Center
Egor Zakharov
Samsung AI Center, Moscow
Kirill Neklyudov
Research Fellow, Higher School of Economics
Dmitry Molchanov
Research Fellow, Higher School of Economics
Yermek Kapushev
PhD student, Skoltech
Viktor Yanush
MSc Student, Lomonosov Moscow State University

Organizing Committee

Dmitry Vetrov
Head of the School
Nadezhda Chirkova
Organizer
Darya Voronkova
Organization Manager

FAQ

  • How do I apply?

    Fill out the form in the Apply section.

  • What is the language of the school?

    The working language of the school is English. All the lectures and practical sessions will be held in English, so the participants will need sufficient proficiency in technical English.

  • What is the participation fee?

    The fee is 1000 rubles for university students (if enrolled by August 2019), 10 000 rubles for academic researchers and 30 000 rubles for participants from industry.

  • If I pay the fee, does it automatically mean I can participate?

    No, candidates will have to complete the application form. The participants will be selected on a competitive basis. Only approved candidates will be asked to proceed with paying the fee. The selection process is necessary because we have a limited number of spots available, and we also want to make sure that our participants have a suitable background to understand the material and have a useful experience at Deep|Bayes School.

  • What is the selection process like?

    Candidates fill an application form, write a short essay (paper review) and complete a few small assignments to demonstrate their knowledge of machine learning and programming skills. The selection committee will carefully review all the applications and will proceed with the strongest candidates based on their technical skills and motivation.

  • How competitive is the admission?

    Last year we received about 300 applications for 100 slots (however, for this year the number of available slots may be different).

  • Will meals be provided?

    We will provide coffee breaks and lunches.

  • I do not know much about machine learning, but I would like to learn more. Should I participate in Deep|Bayes school?

    Unfortunately, no. Our summer school is intended for candidates who have strong knowledge of machine learning and are familiar with neural networks. Such level of participants enables us to delve into to technical details and quickly proceed to advanced topics while being confident that the material is accessible for everyone. For learning machine learning fundamentals, we encourage you to check out numerous resources available on the web.

  • What will I get from participating in the School?

    You will learn modern techniques in deep learning and discover benefits of Bayesian approach for neural networks. Topics discussed during the School will help you understand modern research papers. And, of course, the School provides an excellent opportunity to meet like-minded people and form new professional connections with speakers, tutors and fellow school participants.

  • I live outside Moscow. Can I still participate?

    Yes, if you get selected. We will provide a limited number of travel grants. The amount of the travel grant is fixed (no matter from which country the participant comes). Travel grant can be spent to cover a trip to and from Moscow and accommodation for the time of the summer school.

  • What about lectures live streaming?

    We won’t have live broadcasting, but we will record lectures and upload them as soon as possible.

  • Will you help me to obtain Russian visa?

    Yes, we will provide visa invitation letters for those selected participants who need Russian visa.

  • I have more questions!

    Please, email us at [email protected].

Contact

If you have any further questions about our summer school, feel free to send us an email to [email protected].

You can also follow us on Twitter.