Publications

Rayen Dhahri, Alexander Immer, Betrand Charpentier, Stephan Günnemann, Vincent Fortuin (2024). Shaving Weights with Occam's Razor: Bayesian Sparsification for Neural Networks Using the Marginal Likelihood. arXiv preprint arXiv:2402.15978.

Alexander Möllers, Alexander Immer, Vincent Fortuin, Elvin Isufi (2024). Hodge-Aware Contrastive Learning. International Conference on Acoustics, Speech, and Signal Processing.

Kseniya Petrova, Maksym Tretiakov, Aleksandr Kotov, Anne H. Monsoro-Burq, Leonid Peshkin (2024). A revised single-cell transcriptomic atlas of Xenopus embryo reveals new differentiation dynamics. bioRxiv preprint.

Eliot Wong-Toi, Alex Boyd, Vincent Fortuin, Stephan Mandt (2023). Understanding pathologies of deep heteroskedastic regression. arXiv preprint arXiv:2306.16717.

Alexander Möllers, Alexander Immer, Elvin Isufi, Vincent Fortuin (2023). Uncertainty in Graph Contrastive Learning with Bayesian Neural Networks. Fifth Symposium on Advances in Approximate Bayesian Inference.

Jonas Rothfuss, Martin Josifoski, Vincent Fortuin, Andreas Krause (2023). Scalable PAC-Bayesian Meta-Learning via the PAC-Optimal Hyper-Posterior: From Theory to Practice. Journal of Machine Learning Research.

Agustinus Kristiadi, Alexander Immer, Runa Eschenhagen, Vincent Fortuin (2023). Promises and Pitfalls of the Linearized Laplace in Bayesian Optimization. Fifth Symposium on Advances in Approximate Bayesian Inference.

Mrinank Sharma, Tom Rainforth, Yee Whye Teh, Vincent Fortuin (2023). Incorporating Unlabelled Data into Bayesian Neural Networks. arXiv preprint arXiv:2304.01762.

Kouroche Bouchiat, Alexander Immer, Hugo Yèche, Gunnar Rätsch, Vincent Fortuin (2023). Improving Neural Additive Models with Bayesian Principles. Fifth Symposium on Advances in Approximate Bayesian Inference.

Szilvia Ujváry, Gergely Flamich, Vincent Fortuin, José Miguel Hernández Lobato (2023). Estimating optimal PAC-Bayes bounds with Hamiltonian Monte Carlo. arXiv preprint arXiv:2310.20053.

Vincent Fortuin, Yingzhen Li, Kevin Murphy, Stephan Mandt, Laura Manduchi (2023). Challenges and Perspectives in Deep Generative Modeling (Dagstuhl Seminar 23072). Dagstuhl Reports.

Julyan Arbel, Konstantinos Pitas, Mariia Vladimirova, Vincent Fortuin (2023). A primer on Bayesian neural networks: review and debates. arXiv preprint arXiv:2309.16314.

Zhenisbek Assylbekov, Sultan Nurmukhamedov, Arsen Sheverdin, Thomas Mach (2022). From Hyperbolic Geometry Back to Word Embeddings. Proceedings of the 7th Workshop on Representation Learning for NLP.

James Urquhart Allingham, Florian Wenzel, Zelda E Mariet, Basil Mustafa, Joan Puigcerver, Neil Houlsby, Ghassen Jerfel, Vincent Fortuin, Balaji Lakshminarayanan, Jasper Snoek, Dustin Tran, Carlos Riquelme Ruiz, Rodolphe Jenatton (2022). Sparse MoEs meet Efficient Ensembles. Transactions on Machine Learning Research.

Noah Berner, Vincent Fortuin, Jonas Landman (2022). Quantum Bayesian Neural Networks. Fourth Symposium on Advances in Approximate Bayesian Inference.

Alexander Immer, Lucas Torroba Hennigen, Vincent Fortuin, Ryan Cotterell (2022). Probing as quantifying inductive bias. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

Vincent Fortuin (2022). Priors in Bayesian deep learning: A review. International Statistical Review.

Tristan Cinquin, Alexander Immer, Max Horn, Vincent Fortuin (2022). Pathologies in Priors and Inference for Bayesian Transformers. Fourth Symposium on Advances in Approximate Bayesian Inference.

Florian Schottmann, Vincent Fortuin, Edoardo Ponti, Ryan Cotterell (2022). On Interpretable Reranking-Based Dependency Parsing Systems. Swiss Text Analytics Conference.

Simon Bing, Vincent Fortuin, Gunnar Rätsch (2022). On Disentanglement in Gaussian Process Variational Autoencoders. Fourth Symposium on Advances in Approximate Bayesian Inference.

Lauro Langosco di Langosco, Vincent Fortuin, Heiko Strathmann (2022). Neural Variational Gradient Descent. Fourth Symposium on Advances in Approximate Bayesian Inference.

Marcello Massimo Negri, Vincent Fortuin, Jan Stuehmer (2022). Meta-learning richer priors for VAEs. Fourth Symposium on Advances in Approximate Bayesian Inference.

Alexander Immer, Tycho van der Ouderaa, Gunnar Rätsch, Vincent Fortuin, Mark van der Wilk (2022). Invariance learning in deep neural networks with differentiable Laplace approximations. Advances in Neural Information Processing Systems.

Oren Sultan, Rayen Dhahri, Yauheni Mardan, Tobias Eder, Georg Groh (2022). From Judgement's Premises Towards Key Points.

Vincent Fortuin, Mark Collier, Florian Wenzel, James Urquhart Allingham, Jeremiah Zhe Liu, Dustin Tran, Balaji Lakshminarayanan, Jesse Berent, Rodolphe Jenatton, Effrosyni Kokiopoulou (2022). Deep classifiers with label noise modeling and distance awareness. Transactions on Machine Learning Research.

Seth Nabarro, Stoil Ganev, Adrià Garriga-Alonso, Vincent Fortuin, Mark van der Wilk, Laurence Aitchison (2022). Data augmentation in Bayesian neural networks and the cold posterior effect. Uncertainty in Artificial Intelligence.

Vincent Fortuin, Adrià Garriga-Alonso, Sebastian W Ober, Florian Wenzel, Gunnar Rätsch, Richard E Turner, Mark van der Wilk, Laurence Aitchison (2022). Bayesian neural network priors revisited. International Conference on Learning Representations.

Laura Manduchi, Matthias Hüser, Martin Faltys, Julia Vogt, Gunnar Rätsch, Vincent Fortuin (2021). T-DPSOM: An interpretable clustering method for unsupervised learning of patient health states. Proceedings of the Conference on Health, Inference, and Learning.

Vincent Fortuin, Gideon Dresdner, Heiko Strathmann, Gunnar Rätsch (2021). Sparse Gaussian processes on discrete domains. IEEE Access.

Alexander Immer, Matthias Bauer, Vincent Fortuin, Gunnar Rätsch, Mohammad Emtiyaz Khan (2021). Scalable marginal likelihood estimation for model selection in deep learning. International Conference on Machine Learning.

Metod Jazbec, Matt Ashman, Vincent Fortuin, Michael Pearce, Stephan Mandt, Gunnar Rätsch (2021). Scalable Gaussian process variational autoencoders. International Conference on Artificial Intelligence and Statistics.

Francesco D'Angelo, Vincent Fortuin (2021). Repulsive deep ensembles are Bayesian. Advances in Neural Information Processing Systems.

Arsen Sheverdin, Noud Corten, Alko Knijff, Georg Lange (2021). Reproducibility report for ''Interpretable Complex-Valued Neural Networks for Privacy Protection''. ML Reproducibility Challenge 2020.

Alexandre Bense, Amir Joudaki, Tim GJ Rudner, Vincent Fortuin (2021). PCA Subspaces Are Not Always Optimal for Bayesian Learning. NeurIPS 2021 Workshop on Distribution Shifts: Connecting Methods and Applications.

Jonas Rothfuss, Vincent Fortuin, Martin Josifoski, Andreas Krause (2021). PACOH: Bayes-optimal meta-learning with PAC-guarantees. International Conference on Machine Learning.

Vincent Fortuin (2021). On the Choice of Priors in Bayesian Deep Learning.

Francesco D'Angelo, Vincent Fortuin, Florian Wenzel (2021). On Stein variational neural network ensembles. arXiv preprint arXiv:2106.10760.

Andreas Kopf, Vincent Fortuin, Vignesh Ram Somnath, Manfred Claassen (2021). Mixture-of-Experts Variational Autoencoder for clustering and generating from similarity-based representations on single cell data. PLoS Computational Biology.

Margherita Rosnati, Vincent Fortuin (2021). MGP-AttTCN: An interpretable machine learning model for the prediction of sepsis. Plos ONE.

Fedor Sergeev, Nikita Jain, Ivan Knunyants, George Kostenkov, Ekaterina Trofimova (2021). Fast simulation of the LHCb electromagnetic calorimeter response using VAEs and GANs. Journal of Physics: Conference Series.

Metod Jazbec, Michael Arthur Leopold Pearce, Vincent Fortuin (2021). Factorized Gaussian Process Variational Autoencoders. Third Symposium on Advances in Approximate Bayesian Inference.

Adrià Garriga-Alonso, Vincent Fortuin (2021). Exact Langevin Dynamics with Stochastic Gradients. Third Symposium on Advances in Approximate Bayesian Inference.

Igor B Petrov, Maksim V Muratov, Fedor I Sergeev (2021). Elastic wave propagation modeling during exploratory drilling on artificial ice island. Applied Mathematics and Computational Mechanics for Smart Applications: Proceedings of AMMAI 2020.

Vincent Fortuin, Adrià Garriga-Alonso, Mark van der Wilk, Laurence Aitchison (2021). BNNpriors: A library for Bayesian neural network inference with different prior distributions. Software Impacts.

Francesco D'Angelo, Vincent Fortuin (2021). Annealed Stein Variational Gradient Descent. Third Symposium on Advances in Approximate Bayesian Inference.

Nikolaos Mourdoukoutas, Marco Federici, Georges Pantalos, Mark van der Wilk, Vincent Fortuin (2021). A Bayesian Approach to Invariant Deep Neural Networks. arXiv preprint arXiv:2107.09301.

Arsen Sheverdin, Francesco Monticone, Constantinos Valagiannopoulos (2020). Photonic Inverse Design with Neural Networks: The Case of Invisibility in the Visible. Phys. Rev. Appl..

Igor Borisovich Petrov, Maksim Viktorovich Muratov, Fedor Igorevich Sergeev (2020). Stability analysis of artificial ice islands by methods of mathematical modeling. Doklady Mathematics.

Matthew Ashman, Jonathan So, Will Tebbutt, Vincent Fortuin, Michael Pearce, Richard E Turner (2020). Sparse Gaussian process variational autoencoders. arXiv preprint arXiv:2010.10177.

Vincent Fortuin, Dmitry Baranchuk, Gunnar Rätsch, Stephan Mandt (2020). GP-VAE: Deep probabilistic time series imputation. International Conference on Artificial Intelligence and Statistics.

D Beznosko, K Yelshibekov, R U Beisembaev, E A Beisembaeva, T Beremkulov, A Iakovlev, S Jakupov, A Sheverdin, Z Tagay, T Uakhitov, M I Vildanova, V V Zhukov (2020). Extensive air showers event reconstruction using spatial and temporary particle distribution at Horizon-T experiment. Journal of Physics: Conference Series.

Fedor Sergeev, Elena Bratkovskaya, Ivan Kisel, Iouri Vassiliev (2020). Deep learning for quark--gluon plasma detection in the CBM experiment. International Journal of Modern Physics A.

Kamil Ciosek, Vincent Fortuin, Ryota Tomioka, Katja Hofmann, Richard Turner (2020). Conservative uncertainty estimation by fitting prior networks. International Conference on Learning Representations.

Arsen Sheverdin, Constantinos Valagiannopoulos (2019). Core-shell nanospheres under visible light: Optimal absorption, scattering, and cloaking. Phys. Rev. B.

Vincent Fortuin, Matthias Hüser, Francesco Locatello, Heiko Strathmann, Gunnar Rätsch (2019). SOM-VAE: Interpretable discrete representation learning on time series. International Conference on Learning Representations.

Andreas Georgiou, Vincent Fortuin, Harun Mustafa, Gunnar Rätsch (2019). META$^2$: Memory-efficient taxonomic classification and abundance estimation for metagenomics with deep learning. arXiv preprint arXiv:1909.13146.

Vincent Fortuin, Heiko Strathmann, Gunnar Rätsch (2019). Meta-learning mean functions for Gaussian processes. arXiv preprint arXiv:1901.08098.

Constantinos Valagiannopoulos, Arsen Sheverdin, Adilkhan Sarsen, Aivar Abrashuly (2019). Maximizing Photonic Response with Simple Resonating Structures in Various Geometries. APS March Meeting Abstracts.

Laura Manduchi, Matthias Hüser, Julia Vogt, Gunnar Rätsch, Vincent Fortuin (2019). DPSOM: Deep probabilistic clustering with self-organizing maps. arXiv preprint arXiv:1910.01590.

Stefan Ganscha, Vincent Fortuin, Max Horn, Eirini Arvaniti, Manfred Claassen (2018). Supervised learning on synthetic data for reverse engineering gene regulatory networks from experimental time-series. bioRxiv.

Tim GJ Rudner, Vincent Fortuin, Yee Whye Teh, Yarin Gal (2018). On the connection between neural processes and Gaussian processes with deep kernels. Workshop on Bayesian Deep Learning, NeurIPS.

Vincent Fortuin, Romann Weber, Sasha Schriber, Diana Wotruba, Markus Gross (2018). InspireMe: learning sequence models for stories. Proceedings of the AAAI Conference on Artificial Intelligence.