


default search action
Torsten Hoefler
Torsten Höfler
Person information
- affiliation: ETH Zürich
Refine list

refinements active!
zoomed in on ?? of ?? records
view refined list in
showing all ?? records
2020 – today
- 2026
[j83]Torsten Hoefler
, Mikhail Khalilov, Josiah Clark, Surendra Anubolu, Mohan Kalkunte, Karen Schramm, Eric Spada, Duncan Roweth, Keith D. Underwood, Adrian M. Caulfield
, Abdul Kabbani, Amirreza Rastegari:
In-Network Collective Operations: Game Changer or Challenge for AI Workloads? Computer 59(1): 24-33 (2026)
[j82]Maciej Besta
, Florian Scheidl, Lukas Gianinazzi, Grzegorz Kwasniewski, Shachar Klaiman, Jürgen Müller, Torsten Hoefler
:
Demystifying Higher-Order Graph Neural Networks. IEEE Trans. Pattern Anal. Mach. Intell. 48(3): 2544-2565 (2026)
[j81]Andrei Ivanov
, Nikoli Dryden
, Tal Ben-Nun
, Timo Schneider
, Saleh Ashkboos
, Torsten Hoefler
:
STen: Productive and Efficient Sparsity in PyTorch. ACM Trans. Archit. Code Optim. 23(2): 74:1-74:25 (2026)
[j80]Tommaso Bonato
, Daniele De Sensi, Salvatore Di Girolamo, Abdulla Bataineh, David Hewson, Duncan Roweth, Torsten Hoefler:
Flowcut Switching: High-Performance Adaptive Routing With In-Order Delivery Guarantees. IEEE Trans. Netw. 34: 1974-1987 (2026)
[j79]Marcus Ritter
, Benedikt Naumann, Alexandru Calotoiu, Sebastian Rinke
, Thorsten Reimann
, Torsten Hoefler
, Felix Wolf
:
Cost-Effective Empirical Performance Modeling. IEEE Trans. Parallel Distributed Syst. 37(2): 575-592 (2026)
[c323]Alejandro Hernández-Cano, Alexander Hägele, Allen Hao Huang, Angelika Romanou, Antoni-Joan Solergibert i Llaquet, Barna Pásztor, Bettina Messmer, Dhia Garbaya, Eduard Frank Durech, Ido Hakimi, Juan Garcia Giraldo, Mete Ismayilzada, Negar Foroutan, Skander Moalla, Tiancheng Chen, Vinko Sabolcec, Yixuan Even Xu, Michael Aerni, Badr AlKhamissi, Ines Altemir Marinas, Mohammad Hossein Amani, Matin Ansaripour, Ilia Badanin, Harold Benoit, Emanuela Boros, Nicholas John Browning, Fabian Bösch, Maximilian Böther, Niklas Canova, Camille Challier, Clément Charmillot, Jonathan Coles, Jan Milan Deriu
, Arnout Devos, Lukas Drescher, Daniil Dzenhaliou, Maud Ehrmann, Dongyang Fan, Simin Fan, Silin Gao, Miguel Gila, María Grandury, Diba Hashemi, Alexander Miserlis Hoyle, Jiaming Jiang, Mark Klein, Andrei Kucharavy, Anastasiia Kucherenko, Frederike Lübeck, Roman Machacek, Theofilos Ioannis Manitaras, Andreas Marfurt, Kyle Matoba, Simon Matrenok, Henrique Mendonça, Fawzi Roberto Mohamed, Syrielle Montariol, Luca Mouchel, Sven Najem-Meyer, Jingwei Ni, Gennaro Oliva, Matteo Pagliardini, Elia Palme, Andrei Panferov, Léo Paoletti, Marco Passerini, Ivan Pavlov, Auguste Poiroux, Kaustubh Ponkshe, Nathan Ranchin, Javier Rando, Mathieu Sauser, Jakhongir Saydaliev, Mukhammadali Sayfiddinov, Marian Schneider, Stefano Schuppli, Marco Scialanga, Andrei Semenov, Kumar Shridhar, Raghav Singhal, Anna Sotnikova, Alexander Sternfeld, Ayush Kumar Tarun, Paul Teiletche, Jannis Vamvas, Xiaozhe Yao, Hao Zhao, Alexander Ilic, Ana Klimovic, Andreas Krause, Caglar Gulcehre, David Rosenthal, Elliott Ash, Florian Tramèr, Joost VandeVondele, Livio Veraldi, Martin Rajman, Thomas C. Schulthess, Torsten Hoefler, Antoine Bosselut, Martin Jaggi, Imanol Schlag:
Apertus: Democratizing Open and Compliant LLMs for Global Language Environments. ACL (1) 2026: 46877-46955
[c322]Aofeng Shen, Chi Zhang, Yakup Budanaz, Alexandru Calotoiu, Bowen Wang, Torsten Hoefler, Luca Benini:
Design in Tiles: Automating GEMM Deployment on Tile-Based Many-PE Accelerators. ASAP 2026: 165-166
[c321]Tommaso Bonato
, Abdul Kabbani
, Ahmad Ghalayini
, Michael Papamichael
, Mohammad Dohadwala
, Lukas Gianinazzi
, Mikhail Khalilov
, Elias Achermann
, Daniele De Sensi
, Torsten Hoefler
:
REPS: Recycled Entropy Packet Spraying for Adaptive Load Balancing and Failure Mitigation. EuroSys 2026: 225-246
[c320]Chang Chen, Tiancheng Chen, Jiangfei Duan, Qianchao Zhu, Zerui Wang, Qinghao Hu, Peng Sun, Xiuhong Li, Chao Yang, Torsten Hoefler:
Zeppelin: Balancing Variable-length Workloads in Data Parallel Large Model Training. EuroSys 2026: 1879-1893
[c319]Jiale Chen, Yalda Shabanzadeh, Elvir Crncevic, Torsten Hoefler, Dan Alistarh:
The Geometry of LLM Quantization: GPTQ as Babai's Nearest Plane Algorithm. ICLR 2026
[c318]Vage Egiazarian, Roberto L. Castro, Denis Kuznedelev, Andrei Panferov, Eldar Kurtic, Shubhra Pandit, Alexandre Noll Marques, Mark Kurtz, Saleh Ashkboos, Torsten Hoefler, Dan Alistarh:
Bridging the Gap Between Promise and Performance for Microscaling FP4 Quantization. ICLR 2026
[c317]Georgios Vlassis, Saleh Ashkboos, Alexandra Volkova, Torsten Hoefler, Dan Alistarh:
Beyond Outliers: A Study of Optimizers Under Quantization. ICLR 2026
[c316]Tommaso Bonato, Ales Kubicek, Abdul Kabbani, Ahmad Ghalayini, Maciej Besta, Torsten Hoefler:
Spritz: Path-Aware Load Balancing in Low-Diameter Networks. IPDPS 2026: 527-543
[c315]Maciej Besta, Patrick Iff, Marcel Schneider, Nils Blach, Alessandro Maissen, Salvatore Di Girolamo, Jens Domke, Jascha Krattenmacher, Kartik Lakhotia, Laura Monroe, Fabrizio Petrini, Robert Gerstenberger, Torsten Hoefler:
EvalNet: A Practical Toolchain for Generation and Analysis of Extreme-Scale Interconnects. IPDPS 2026: 804-818
[c314]Marcin Chrapek, Siyuan Shen, Patrick Iff, Tiancheng Chen, Mikhail Khalilov, Marcin Copik, Maciej Besta, Torsten Hoefler:
SecPerf: Demystifying Cost of Confidential HPC. IPDPS 2026: 850-867
[c313]Valerio Torsiello
, Ayush Mishra
, Sushovan Das
, Lukas Röllin
, Tommaso Bonato
, Torsten Hoefler
, Laurent Vanbever
:
Ampel: Scheduling at the Network Cut in ML Training. SIGCOMM 2026: 1973-1980
[c312]Patrick Iff
, Paul Brügger
, Marcin Chrapek
, David Kochergin
, Maciej Besta
, Torsten Hoefler
:
Benchmarking Filtered Approximate Nearest Neighbor Search Algorithms on Transformer-based Embedding Vectors. SIGIR 2026: 610-622
[c311]Saverio Pasqualoni, Tommaso Bonato, Lorenzo Piarulli, Torsten Hoefler, Marco Canini
, Daniele De Sensi:
PICO: Performance Insights for Collective Operations. ISC High Performance 2026: 1-14
[d17]Maciej Besta
, Patrick Iff
, Marcel Schneider, Nils Blach
, Alessandro Maissen
, Salvatore Di Girolamo
, Jens Domke, Jascha Krattenmacher
, Kartik Lakhotia
, Laura Monroe
, Fabrizio Petrini
, Robert Gerstenberger
, Torsten Hoefler
:
EvalNet Software Artifact. Zenodo, 2026
[d16]Langwen Huang
, Luigi Fusco, Florian Scheidl, Jan Zibell
, Michael Sprenger, Sebastian Schemm
, Torsten Hoefler
:
Error-bounded Compression Benchmark for Weather and Climate Applications. Version 1. Zenodo, 2026 [all versions]
[d15]Langwen Huang
, Luigi Fusco, Florian Scheidl, Jan Zibell
, Michael Sprenger, Sebastian Schemm
, Torsten Hoefler
:
Error-bounded Compression Benchmark for Weather and Climate Applications. Version 2. Zenodo, 2026 [all versions]
[i264]Berke Ates, Philipp Schaad, Timo Schneider, Alexandru Calotoiu, Torsten Hoefler:
MLIR-Forge: A Modular Framework for Language Smiths. CoRR abs/2601.09583 (2026)
[i263]Torsten Hoefler, Mikhail Khalilov, Josiah Clark, Surendra Anubolu, Mohan Kalkunte, Karen Schramm, Eric Spada, Duncan Roweth, Keith D. Underwood, Adrian M. Caulfield, Abdul Kabbani, Amirreza Rastegari:
In-Network Collective Operations: Game Changer or Challenge for AI Workloads? CoRR abs/2601.19132 (2026)
[i262]Maciej Besta, Lukasz Jarmocik, Orest Hrycyna, Shachar Klaiman, Konrad Maczka, Robert Gerstenberger, Jürgen Müller, Piotr Nyczyk, Hubert Niewiadomski, Torsten Hoefler:
GraphSeek: Next-Generation Graph Analytics with LLMs. CoRR abs/2602.11052 (2026)
[i261]Tommaso Bonato, Ales Kubicek, Abdul Kabbani, Ahmad Ghalayini, Maciej Besta, Torsten Hoefler:
Spritz: Path-Aware Load Balancing in Low-Diameter Networks. CoRR abs/2602.19567 (2026)
[i260]Yuejiang Yu, Langwen Huang, Alexandru Calotoiu, Torsten Hoefler:
Scaling Laws of Global Weather Models. CoRR abs/2602.22962 (2026)
[i259]Patrick Iff, Tommaso Bonato, Maciej Besta, Luca Benini, Torsten Hoefler:
Network Design for Wafer-Scale Systems with Wafer-on-Wafer Hybrid Bonding. CoRR abs/2603.05266 (2026)
[i258]Jiwoong Sohn, Tomasz Sternal, Kenneth Styppa, Torsten Hoefler, Michael Moor:
Process Reward Agents for Steering Knowledge-Intensive Reasoning. CoRR abs/2604.09482 (2026)
[i257]Jonathan Coles, Stefano Schuppli, Lukas Drescher, Fawzi Mohamed, Elia Palme, Henrique Mendonça, Miguel Gila, Mark Klein, Maxime Martinasso, Joost VandeVondele, Torsten Hoefler, Thomas C. Schulthess, Josh Romero, Igor Gorodetsky, Ryan Hankins, Isa Wazirzada, Martin Jaggi, Antoine Bosselut, Imanol Schlag, Antoni-Joan Solergibert i Llaquet, Alejandro Hernández-Cano, Theofilos Ioannis Manitaras, Nicholas John Browning:
An Engineering Journey Training Large Language Models at Scale on Alps: The Apertus Experience. CoRR abs/2604.12973 (2026)
[i256]Alexis Limozin, Eduard Durech, Torsten Hoefler, Imanol Schlag, Valentina Pyatkin:
SFT-then-RL Outperforms Mixed-Policy Methods for LLM Reasoning. CoRR abs/2604.23747 (2026)
[i255]Firat Ozdemir, Yun Cheng, Salman Mohebi, Fanny Lehmann, Simon Adamov, Zhenyi Zhang, Leonardo Trentini, Dana Grund, Oliver Fuhrer, Torsten Hoefler, Siddhartha Mishra, Sebastian Schemm
, Benedikt Soja, Mathieu Salzmann:
Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecasting. CoRR abs/2605.00850 (2026)
[i254]Joao Araujo, Alex Chow, Mark Handley, Ryder Lewis, Christoph Paasch, Jitendra Padhye, Michael Papamichael, Greg Steinbrecher, Amin Tootoonchian, Lihua Yuan, Sreevatsa Anantharamu, Abhishek Dosi, Mohit Garg, Mahdieh Ghazimirsaeed, Torsten Hoefler, Deepal Jayasinghe, Jithin Jose, Abdul Kabbani, Guohan Lu, Yang Wang, K. Doddapaneni, Murali Garimella, Vipin Jain, Yanfang Le, H. Nagulapalli, S. Narayanan, Rong Pan, Rathina Sabesan, Raghava Sivaramu, Rip Sohan, Eric Davis, Dragos Dumitrescu, Mohan Kalkunte, Bhaswar Mitra, Guglielmo Morandin, Adrian Popa, Costin Raiciu, Eric Spada, John Spillane, Niranjan Vaidya, Aviv Barnea, Idan Burstein, Elazar Cohen, Yamin Friedman, Noam Katz, Masoud Moshref, Yuval Shpigelman, Shahaf Shuler, Shy Shyman, Sayantan Sur:
Resilient AI Supercomputer Networking using MRC and SRv6. CoRR abs/2605.04333 (2026)
[i253]Afif Boudaoud, Lisa Gaedke-Merzhäuser, Alexandros Nikolaos Ziogas, Vincent Maillou, Alexandru Calotoiu, Marcin Copik, Håvard Rue, Mathieu Luisier, Torsten Hoefler:
ADELIA: Automatic Differentiation for Efficient Laplace Inference Approximations. CoRR abs/2605.06392 (2026)
[i252]Vage Egiazarian, Erik Schultheis, Andrei Panferov, Earl Killian, Torsten Hoefler, Dan Alistarh:
Grid Games: The Power of Multiple Grids for Quantizing Large Language Models. CoRR abs/2605.12327 (2026)
[i251]Yavuz Durmazkeser, Patrik Okanovic, Andreas Kirsch, Torsten Hoefler, Nezihe Merve Gürel:
Large Language Model Selection with Limited Annotations. CoRR abs/2605.24981 (2026)
[i250]Drago Plecko, Patrik Okanovic, Torsten Hoefler, Elias Bareinboim:
Confounder Detection via Treatment Intent: A New Observational Study Design. CoRR abs/2605.26413 (2026)
[i249]Fanny Lehmann, Firat Ozdemir, Yun Cheng, Torsten Hoefler, Sebastian Schemm
, Benedikt Soja, Siddhartha Mishra:
Can AI Weather Models Predict Beyond Two Weeks? A Quantitative Benchmark and Analysis of Long Rollouts. CoRR abs/2605.30184 (2026)
[i248]Qiao Xiao, Boqian Wu, Patrik Okanovic, Tomasz Sternal, Maurice van Keulen, Elena Mocanu, Mykola Pechenizkiy, Decebal Constantin Mocanu, Torsten Hoefler:
Memory-Efficient LLM Training with Dynamic Sparsity: From Stability to Practical Scaling. CoRR abs/2606.00888 (2026)
[i247]Boqian Wu, Qiao Xiao, Patrik Okanovic, Tomasz Sternal, Maurice van Keulen, Mykola Pechenizkiy, Elena Mocanu, Torsten Hoefler, Decebal Constantin Mocanu:
When Data Is Scarce: Scaling Sparse Language Models with Repeated Training. CoRR abs/2606.01155 (2026)
[i246]Yijun Ma, Siyuan Shen, Tiancheng Chen, Akhil Langer, Jiri Kraus, Benjamin Glick, Craig Belusar, Jeff R. Hammond, Torsten Hoefler:
Demystifying NVSHMEM: A System-Level Analysis on Symmetric Memory and Device-Initiated Operations in GPU Communication. CoRR abs/2606.05951 (2026)
[i245]Rip Sohan, Eric Spada, Eric Davis, Mark Handley, Idan Burstein, Tony Hurson, Jithin Jose, Vivek Kashyap, Rong Pan, Sayantan Sur, Sreevatsa Anantharamu, Aviv Barnea, Adrian M. Caulfield, Elazar Cohen, Elliot Edmunds, Yamin Friedman, Mahdieh Ghazimirsaeed, Murali Guramali, Torsten Hoefler, Vipin Jain, Abdul Kabbani, Noam Katz, Yanfang Le, Charlie Mbariky, Guglielmo Morandin, Masoud Moshref, Shane O'Neil, Michael Papamichael, Jonas Pfefferle, Siva Santosh Pyla, Costin Raiciu, David Riddoch, Karen Schramm, Yuval Shpigelman, Shahaf Shuler, Shy Shyman, Raghava Sivaramu, Amin Tootoonchian, Yang Wang:
The Multipath Reliable Connection (MRC) Transport. CoRR abs/2606.18170 (2026)
[i244]Siyuan Shen, Anton Korzh, John Bachan, Tiancheng Chen, Arnav Goel, Ludwig Schneider, Pouya Kousha, Zhenhao He, Sylvain Jeaugey, Kamil Iskra, Nishank Chandawala, Jeff R. Hammond, Torsten Hoefler:
Every Microsecond Matters: Achieving Near Speed-of-Light Latency in GPU Collectives. CoRR abs/2607.16100 (2026)
[i243]Jiale Chen
, Torsten Hoefler, Dan Alistarh:
GPTQ-2D: Cubic-Time Two-Sided Adaptive Rounding. CoRR abs/2607.27042 (2026)
[i242]Sherry Xu, Marco Heddes, Jackson Peng, Tom Savell, Monica Tang, Prashant Ranjan, Jesse Benson, Ofer Dekel, Saurabh Dighe, Anupama Kurpad, Artour Levin, Matthew Mattina, George Petre, Cheng Tang, Yuan Yu, Li Zhang, Torsten Hoefler:
Maia 200: A Software Defined Dataflow System for Large-scale AI Acceleration. CoRR abs/2608.24664 (2026)
[i241]Maciej Besta, Leonard Schmidt, Lara Nonino, Robert Gerstenberger, Pierre Pang, Patrik Okanovic, Ales Kubicek, Tiancheng Chen, Baraq Lipshitz, Torsten Hoefler:
Performance Foundations of Parallel & Distributed Reasoning Language Models. CoRR abs/2608.27046 (2026)
[i240]Qimen Xu, Yu Zhang, Dixing Ni, Lei Gao, Guangnan Feng, Qinrui Zheng, Jianting Liu, Haitian Lu, Zhaopeng Jia, Wei Xue, Shriram Chandran, Torsten Hoefler, Haohuan Fu, Yutong Lu:
Extreme-Scale Linear-Scaling Kohn-Sham DFT at 100 Million Atoms: Bridging Quantum Simulations and Experiments. CoRR abs/2609.13115 (2026)
[i239]Torsten Hoefler, Matthias Troyer:
Quantum computers will not be that different: A blueprint for quantum computer architecture at scale. CoRR abs/2609.19639 (2026)
[i238]Yakup Budanaz, Pratyai Mazumder, Alexandru Calotoiu, Torsten Hoefler:
The Canonical Parallel Form as a Substrate for Parallelizing Compilers and Agentic Optimizers. CoRR abs/2609.28724 (2026)
[i237]Afif Boudaoud, Jiayi Liu, Alexandru Calotoiu, Torsten Hoefler:
Gauss What You Need: Compact Gaussian Splatting Across Scene Scales. CoRR abs/2609.31248 (2026)
[i236]Shriram Chandran, Dominic Rinderer, Yakup Budanaz, Alexandru Calotoiu, Marcin Copik, Torsten Hoefler:
Hardware-Aware Features for CUTLASS Kernel Selection. CoRR abs/2609.35587 (2026)
[i235]Pratyai Mazumder, Alexandru Calotoiu, Torsten Hoefler:
FP64 Is All You Want, INT8 Is All You Need, FP4/6/8 Is All You Have. CoRR abs/2609.37693 (2026)
[i234]Jiale Chen, Vage Egiazarian, Eldar Kurtic, Torsten Hoefler, Dan Alistarh:
WUSH-KV: KV Cache Quantization with Data-Adaptive Transforms. CoRR abs/2609.38121 (2026)- 2025
[j78]Anna Speckert
, Lukas Gianinazzi
, Sepp Kollmorgen, Cornelia F. Hagmann
, Patrice Grehten, Raimund Kottke
, Giancarlo Natalucci
, Beatrice Latal, Walter Knirsch, Ruth Tuura
, Torsten Hoefler
, András Jakab:
Atlas-independent brain connectome analysis at voxel-level granularity: graph convolutional networks for etiology classification in newborns. NeuroImage 322: 121568 (2025)
[j77]Maciej Besta
, Florim Memedi, Zhenyu Zhang, Robert Gerstenberger
, Guangyuan Piao, Nils Blach
, Piotr Nyczyk, Marcin Copik
, Grzegorz Kwasniewski, Jürgen Müller, Lukas Gianinazzi, Ales Kubicek
, Hubert Niewiadomski, Aidan O'Mahony
, Onur Mutlu, Torsten Hoefler
:
Demystifying Chains, Trees, and Graphs of Thoughts. IEEE Trans. Pattern Anal. Mach. Intell. 47(12): 10967-10989 (2025)
[j76]Wenqi Jiang, Hang Hu, Torsten Hoefler, Gustavo Alonso:
Fast Graph Vector Search via Hardware Acceleration and Delayed-Synchronization Traversal. Proc. VLDB Endow. 18(11): 3797-3811 (2025)
[j75]Andrea Lepori
, Alexandru Calotoiu
, Torsten Hoefler
:
Iterating Pointers: Enabling Static Analysis for Loop-based Pointers. ACM Trans. Archit. Code Optim. 22(1): 4:1-4:25 (2025)
[j74]Marcin Copik
, Lukas Möller
, Alexandru Calotoiu
, Torsten Hoefler
:
Cppless: Single-Source and High-Performance Serverless Programming in C++. ACM Trans. Archit. Code Optim. 22(3): 110:1-110:27 (2025)
[j73]Yuyang Jin
, Haojie Wang
, Xiongchao Tang, Zhenhua Guo, Yaqian Zhao, Torsten Hoefler
, Tao Liu
, Xu Liu, Jidong Zhai
:
Leveraging Graph Analysis to Pinpoint Root Causes of Scalability Issues for Parallel Applications. IEEE Trans. Parallel Distributed Syst. 36(2): 308-325 (2025)
[j72]Alexandros Nikolaos Ziogas
, Timo Schneider, Tal Ben-Nun, Alexandru Calotoiu, Tiziano De Matteis
, Johannes de Fine Licht, Luca Lavarini, Torsten Hoefler:
Productivity, Portability, Performance, and Reproducibility: Data-Centric Python. IEEE Trans. Parallel Distributed Syst. 36(5): 804-820 (2025)
[c310]Patrik Okanovic, Andreas Kirsch, Jannes Kasper, Torsten Hoefler, Andreas Krause, Nezihe Merve Gürel:
All models are wrong, some are useful: Model Selection with Limited Labels. AISTATS 2025: 2035-2043
[c309]Patrick Iff
, Benigna Bruggmann
, Blaise Morel
, Maciej Besta
, Luca Benini
, Torsten Hoefler
:
RapidChiplet: A Toolchain for Rapid Design Space Exploration of Inter-Chiplet Interconnects. CF 2025: 168-171
[c308]Lukas Trümper
, Philipp Schaad
, Berke Ates
, Alexandru Calotoiu
, Marcin Copik
, Torsten Hoefler
:
A Priori Loop Nest Normalization: Automatic Loop Scheduling in Complex Applications. CGO 2025: 418-430
[c307]Afif Boudaoud, Alexandru Calotoiu, Marcin Copik, Torsten Hoefler:
DaCe AD: Unifying High-Performance Automatic Differentiation for Machine Learning and Scientific Computing. CLUSTER 2025: 1-13
[c306]Stefano Schuppli
, Fawzi Mohamed
, Henrique Mendonça
, Nina Mujkanovic
, Elia Palme
, Dino Conciatore
, Lukas Drescher
, Miguel Gila
, Pim Witlox
, Joost VandeVondele
, Maxime Martinasso
, Thomas C. Schulthess
, Torsten Hoefler
:
Evolving HPC services to enable ML workloads on HPE Cray EX. CUG 2025: 166-177
[c305]Larissa Schmid
, Marcin Copik
, Alexandru Calotoiu
, Laurin Brandner
, Anne Koziolek
, Torsten Hoefler
:
SeBS-Flow: Benchmarking Serverless Cloud Function Workflows. EuroSys 2025: 902-920
[c304]Timo Schneider, Pengcheng Xu, Torsten Hoefler:
FPsPIN: An FPGA-Based Open-Hardware Research Platform for Processing in the Network. HOTI 2025: 1-11
[c303]Zhiyi Hu, Siyuan Shen, Tommaso Bonato, Sylvain Jeaugey, Cedell Alexander, Eric Spada, James Dinan, Jeff R. Hammond, Torsten Hoefler:
Demystifying NCCL: An In-Depth Analysis of GPU Communication Protocols and Algorithms. HOTI 2025: 48-59
[c302]Siyuan Shen
, Mikhail Khalilov
, Lukas Gianinazzi
, Timo Schneider
, Marcin Chrapek
, Jai Dayal
, Manisha Gajbe
, Robert W. Wisniewski
, Torsten Hoefler
:
EDAN: Towards Understanding Memory Parallelism and Latency Sensitivity in HPC. ICS 2025: 1005-1019
[c301]Marcin Chrapek, Marcin Copik, Etienne Mettaz, Torsten Hoefler:
Confidential LLM Inference: Performance and Cost Across CPU and GPU TEEs. IISWC 2025: 84-98
[c300]Lukas Gianinazzi, Tal Ben-Nun, Maciej Besta, Saleh Ashkboos, Yves Baumann, Piotr Luczynski, Torsten Hoefler:
Energy-Optimal and Low-Depth Algorithmic Primitives for Spatial Dataflow Architectures. IPDPS 2025: 142-153
[c299]Saleh Ashkboos, Mahdi Nikdan, Rush Tabesh, Roberto L. Castro, Torsten Hoefler, Dan Alistarh:
HALO: Hadamard-Assisted Lower-Precision Optimization for LLMs. NeurIPS 2025
[c298]Elias Frantar
, Roberto L. Castro
, Jiale Chen
, Torsten Hoefler
, Dan Alistarh
:
MARLIN: Mixed-Precision Auto-Regressive Parallel Inference on Large Language Models. PPoPP 2025: 239-251
[c297]Nicolas Vetsch
, Alexander Maeder
, Vincent Maillou
, Anders Winka
, Jiang Cao
, Grzegorz Kwasniewski
, Leonard Deuschle
, Torsten Hoefler
, Alexandros Nikolaos Ziogas
, Mathieu Luisier
:
Ab-initio Quantum Transport with the GW Approximation, 42, 240 Atoms, and Sustained Exascale Performance. SC 2025: 1-13
[c296]Daniel Klocke
, Claudia Frauen
, Jan Frederik Engels
, Dmitry Alexeev
, René Redler
, Reiner Schnur
, Helmuth Haak
, Luis Kornblueh
, Nils Brüggemann
, Fatemeh Chegini, Manoel Römmer
, Lars Hoffmann
, Sabine Griessbach
, Mathis Bode
, Jonathan Coles
, Miguel Gila
, William Sawyer
, Alexandru Calotoiu
, Yakup Budanaz
, Pratyai Mazumder
, Marcin Copik
, Benjamin Weber
, Andreas Herten
, Hendryk Bockelmann
, Torsten Hoefler
, Cathy Hohenegger
, Bjorn Stevens
:
Computing the Full Earth System at 1km Resolution. SC 2025: 125-136
[c295]Andrei Ivanov
, Siyuan Shen
, Gioele Gottardo
, Marcin Chrapek
, Afif Boudaoud
, Timo Schneider
, Luca Benini
, Torsten Hoefler
:
PerfDojo: Automated ML Library Generation for Heterogeneous Architectures. SC 2025: 137-151
[c294]Philipp Schaad
, Tal Ben-Nun
, Torsten Hoefler
:
C.A.T.S.: Memory and Control Flow Tracing for Whole-Program Performance Analysis. SC 2025: 331-348
[c293]Siyuan Shen
, Tommaso Bonato
, Zhiyi Hu
, Pasquale Jordan
, Tiancheng Chen
, Torsten Hoefler
:
ATLAHS: An Application-centric Network Simulator Toolchain for AI, HPC, and Distributed Storage. SC 2025: 349-367
[c292]Marcin Copik
, Eiman Alnuaimi
, Alok Kamatar
, Valérie Hayot-Sasson
, Alberto Madonna
, Todd Gamblin
, Kyle Chard
, Ian T. Foster
, Torsten Hoefler
:
XaaS Containers: Performance-Portable Representation With Source and IR Containers. SC 2025: 533-555
[c291]Alok Kamatar
, Maxime Gonthier
, Valérie Hayot-Sasson
, André Bauer
, Marcin Copik
, Raul Castro Fernandez
, Torsten Hoefler
, Kyle Chard
, Ian T. Foster
:
Core Hours and Carbon Credits: Incentivizing Sustainability in HPC. SC 2025: 870-887
[c290]Tommaso Bonato
, Sepehr Abdous
, Abdul Kabbani
, Ahmad Ghalayini
, Nadeen Gebara
, Terry Lam
, Anup Agarwal
, Tiancheng Chen
, Zhuolong Yu
, Konstantin Taranov
, Mahmoud Elhaddad
, Daniele De Sensi
, Soudeh Ghorbani
, Torsten Hoefler
:
Uno: A One-Stop Solution for Inter- and Intra-Data Center Congestion Control and Reliable Connectivity. SC 2025: 1195-1210
[c289]Mikhail Khalilov
, Siyuan Shen
, Marcin Chrapek
, Tiancheng Chen
, Kenji Nakano
, Nicola Mazzoletti
, Peter-Jan Gootzen
, Salvatore Di Girolamo
, Rami Nudelman
, Gil Bloch
, Jithin Jose
, Abdul Kabbani
, Sreevatsa Anantharamu
, Jie Zhang
, Konstantin Taranov
, Zhuolong Yu
, Scott Moe
, Mahmoud Elhaddad
, Torsten Hoefler
:
SDR-RDMA: Software-Defined Reliability Architecture for Planetary Scale RDMA Communication. SC 2025: 1223-1239
[c288]Daniele De Sensi
, Saverio Pasqualoni
, Lorenzo Piarulli
, Tommaso Bonato
, Seydou Ba
, Matteo Turisini
, Jens Domke
, Torsten Hoefler
:
Bine Trees: Enhancing Collective Operations by Optimizing Communication Locality. SC 2025: 1901-1916
[c287]Marcin Copik
, Alexandru Calotoiu
, Torsten Hoefler
:
SeBS 2.0: Keeping up with the Clouds. SESAME@EuroSys 2025: 42-44
[c286]Tiancheng Chen, Ales Kubicek, Langwen Huang, Torsten Hoefler:
CrossPipe: Towards Optimal Pipeline Schedules for Cross-Datacenter Training. USENIX ATC 2025: 1089-1108
[d14]Marcin Copik
, Lukas Möller
, Alexandru Calotoiu
, Torsten Hoefler
:
Cppless: Single-Source and High-Performance Serverless Programming in C++. Zenodo, 2025
[d13]Larissa Schmid
, Marcin Copik
, Alexandru Calotoiu
, Laurin Brandner
, Anne Koziolek
, Torsten Hoefler
:
Replication Package for "SeBS-Flow: Benchmarking Serverless Cloud Function Workflows". Version 1. Zenodo, 2025 [all versions]
[d12]Larissa Schmid
, Marcin Copik
, Alexandru Calotoiu
, Laurin Brandner
, Anne Koziolek
, Torsten Hoefler
:
Replication Package for "SeBS-Flow: Benchmarking Serverless Cloud Function Workflows". Version 2. Zenodo, 2025 [all versions]
[d11]Larissa Schmid
, Marcin Copik
, Alexandru Calotoiu
, Laurin Brandner
, Anne Koziolek
, Torsten Hoefler
:
Replication Package for "SeBS-Flow: Benchmarking Serverless Cloud Function Workflows". Version 3. Zenodo, 2025 [all versions]
[d10]Larissa Schmid
, Marcin Copik
, Alexandru Calotoiu
, Laurin Brandner
, Anne Koziolek
, Torsten Hoefler
:
Replication Package for "SeBS-Flow: Benchmarking Serverless Cloud Function Workflows". Version 4. Zenodo, 2025 [all versions]
[d9]Larissa Schmid
, Marcin Copik
, Alexandru Calotoiu
, Laurin Brandner
, Anne Koziolek
, Torsten Hoefler
:
Replication Package for "SeBS-Flow: Benchmarking Serverless Cloud Function Workflows". Version 5. Zenodo, 2025 [all versions]
[d8]Larissa Schmid
, Marcin Copik
, Alexandru Calotoiu
, Laurin Brandner
, Anne Koziolek
, Torsten Hoefler
:
Replication Package for "SeBS-Flow: Benchmarking Serverless Cloud Function Workflows". Version 6. Zenodo, 2025 [all versions]
[d7]Larissa Schmid
, Marcin Copik
, Alexandru Calotoiu
, Laurin Brandner
, Anne Koziolek
, Torsten Hoefler
:
Replication Package for "SeBS-Flow: Benchmarking Serverless Cloud Function Workflows". Version 7. Zenodo, 2025 [all versions]
[d6]Marcin Copik
, Eiman Alnuaimi
, Alok Kamatar
, Valérie Hayot-Sasson
, Alberto Madonna
, Todd Gamblin
, Kyle Chard
, Ian T. Foster
, Torsten Hoefler
:
XaaS Containers: Performance-Portable Representation With Source and IR Containers. Zenodo, 2025
[i233]Saleh Ashkboos, Mahdi Nikdan, Soroush Tabesh, Roberto L. Castro, Torsten Hoefler, Dan Alistarh:
HALO: Hadamard-Assisted Lower-Precision Optimization for LLMs. CoRR abs/2501.02625 (2025)
[i232]Alok Kamatar, Maxime Gonthier, Valérie Hayot-Sasson, André Bauer, Marcin Copik, Torsten Hoefler, Raul Castro Fernandez, Kyle Chard, Ian T. Foster:
Core Hours and Carbon Credits: Incentivizing Sustainability in HPC. CoRR abs/2501.09557 (2025)
[i231]Maciej Besta, Julia Barth, Eric Schreiber, Ales Kubicek, Afonso Claudino Catarino, Robert Gerstenberger, Piotr Nyczyk, Patrick Iff, Yueling Li, Sam Houliston, Tomasz Sternal, Marcin Copik, Grzegorz Kwasniewski, Jürgen Müller, Lukasz Flis, Hannes Eberhard, Hubert Niewiadomski, Torsten Hoefler:
Reasoning Language Models: A Blueprint. CoRR abs/2501.11223 (2025)
[i230]Patrick Iff, Benigna Bruggmann, Maciej Besta, Luca Benini, Torsten Hoefler:
PlaceIT: Placement-based Inter-Chiplet Interconnect Topologies. CoRR abs/2502.01449 (2025)
[i229]Andrea Lepori, Alexandru Calotoiu, Torsten Hoefler:
Iterating Pointers: Enabling Static Analysis for Loop-based Pointers. CoRR abs/2503.03359 (2025)
[i228]Maciej Besta, Lorenzo Paleari
, Jia Hao Andrea Jiang, Robert Gerstenberger, You Wu
, Patrick Iff, Ales Kubicek, Piotr Nyczyk, Diana Khimey, Jón Gunnar Hannesson, Grzegorz Kwasniewski, Marcin Copik, Hubert Niewiadomski, Torsten Hoefler:
Affordable AI Assistants with Knowledge Graph of Thoughts. CoRR abs/2504.02670 (2025)
[i227]Gustavo de Morais, Alexander Geiß, Alexandru Calotoiu, Gregor Corbin, Ahmad Tarraf, Torsten Hoefler, Bernd Mohr, Felix Wolf:
Denoising Application Performance Models with Noise-Resilient Priors. CoRR abs/2504.10996 (2025)
[i226]Patrick Iff, Maciej Besta, Torsten Hoefler:
FoldedHexaTorus: An Inter-Chiplet Interconnect Topology for Chiplet-based Systems using Organic and Glass Substrates. CoRR abs/2504.19878 (2025)
[i225]Mikhail Khalilov, Siyuan Shen, Marcin Chrapek, Tiancheng Chen, Kenji Nakano, Peter-Jan Gootzen, Salvatore Di Girolamo, Rami Nudelman, Gil Bloch, Sreevatsa Anantharamu, Mahmoud Elhaddad, Jithin Jose, Abdul Kabbani, Scott Moe, Konstantin Taranov, Zhuolong Yu, Jie Zhang, Nicola Mazzoletti, Torsten Hoefler:
SDR-RDMA: Software-Defined Reliability Architecture for Planetary Scale RDMA Communication. CoRR abs/2505.05366 (2025)
[i224]Siyuan Shen, Tommaso Bonato, Zhiyi Hu, Pasquale Jordan, Tiancheng Chen, Torsten Hoefler:
ATLAHS: An Application-centric Network Simulator Toolchain for AI, HPC, and Distributed Storage. CoRR abs/2505.08936 (2025)
[i223]Fanny Lehmann, Firat Ozdemir, Benedikt Soja, Torsten Hoefler, Siddhartha Mishra, Sebastian Schemm
:
Finetuning a Weather Foundation Model with Lightweight Decoders for Unseen Physical Processes. CoRR abs/2506.19088 (2025)
[i222]Maciej Besta, Shriram Chandran, Jakub Cudak, Patrick Iff, Marcin Copik, Robert Gerstenberger, Tomasz Szydlo, Jürgen Müller, Torsten Hoefler:
Higher-Order Graph Databases. CoRR abs/2506.19661 (2025)
[i221]Tommaso Bonato, Daniele De Sensi, Salvatore Di Girolamo, Abdulla Bataineh, David Hewson, Duncan Roweth, Torsten Hoefler:
Flowcut Switching: High-Performance Adaptive Routing with In-Order Delivery Guarantees. CoRR abs/2506.21406 (2025)
[i220]Tiancheng Chen, Ales Kubicek, Langwen Huang, Torsten Hoefler:
CrossPipe: Towards Optimal Pipeline Schedules for Cross-Datacenter Training. CoRR abs/2507.00217 (2025)
[i219]Stefano Schuppli, Fawzi Mohamed, Henrique Mendonça, Nina Mujkanovic, Elia Palme, Dino Conciatore, Lukas Drescher, Miguel Gila, Pim Witlox, Joost VandeVondele, Maxime Martinasso, Thomas C. Schulthess, Torsten Hoefler:
Evolving HPC services to enable ML workloads on HPE Cray EX. CoRR abs/2507.01880 (2025)
[i218]Patrik Okanovic, Sameer Deshmukh, Grzegorz Kwasniewski, Kentaro Katayama, Takumi Honda, Maciej Besta, Torsten Hoefler:
BLaST: High Performance Inference and Pretraining using BLock Sparse Transformers. CoRR abs/2507.03117 (2025)
[i217]Zhiyi Hu, Siyuan Shen, Tommaso Bonato, Sylvain Jeaugey, Cedell Alexander, Eric Spada, James Dinan, Jeff R. Hammond, Torsten Hoefler:
Demystifying NCCL: An In-depth Analysis of GPU Communication Protocols and Algorithms. CoRR abs/2507.04786 (2025)
[i216]Jiale Chen
, Torsten Hoefler, Dan Alistarh:
The Geometry of LLM Quantization: GPTQ as Babai's Nearest Plane Algorithm. CoRR abs/2507.18553 (2025)
[i215]Yinxiao Feng, Tiancheng Chen, Yuchen Wei, Siyuan Shen, Shiju Wang, Wei Li, Kaisheng Ma, Torsten Hoefler:
RailX: A Flexible, Scalable, and Low-Cost Network Architecture for Hyper-Scale LLM Training Systems. CoRR abs/2507.18889 (2025)
[i214]Patrick Iff, Paul Bruegger, Marcin Chrapek, Maciej Besta, Torsten Hoefler:
Benchmarking Filtered Approximate Nearest Neighbor Search Algorithms on Transformer-based Embedding Vectors. CoRR abs/2507.21989 (2025)
[i213]Torsten Hoefler, Karen Schramm, Eric Spada, Keith D. Underwood, Cedell Alexander, Bob Alverson, Paul Bottorff, Adrian M. Caulfield, Mark Handley, Cathy Huang, Costin Raiciu, Abdul Kabbani, Eugene Opsasnick, Rong Pan, Adee Ran, Rip Sohan:
Ultra Ethernet's Design Principles and Architectural Innovations. CoRR abs/2508.08906 (2025)
[i212]Daniele De Sensi, Saverio Pasqualoni
, Lorenzo Piarulli, Tommaso Bonato, Seydou Ba, Matteo Turisini, Jens Domke, Torsten Hoefler:
Bine Trees: Enhancing Collective Operations by Optimizing Communication Locality. CoRR abs/2508.17311 (2025)
[i211]Nicolas Vetsch, Alexander Maeder, Vincent Maillou, Anders Winka, Jiang Cao, Grzegorz Kwasniewski, Leonard Deuschle, Torsten Hoefler, Alexandros Nikolaos Ziogas, Mathieu Luisier:
Ab-initio Quantum Transport with the GW Approximation, 42,240 Atoms, and Sustained Exascale Performance. CoRR abs/2508.19138 (2025)
[i210]Afif Boudaoud, Alexandru Calotoiu, Marcin Copik, Torsten Hoefler:
DaCe AD: Unifying High-Performance Automatic Differentiation for Machine Learning and Scientific Computing. CoRR abs/2509.02197 (2025)
[i209]Maciej Besta, Shriram Chandran, Robert Gerstenberger, Mathis Lindner, Marcin Chrapek, Sebastian Hermann Martschat, Taraneh Ghandi, Patrick Iff, Hubert Niewiadomski, Piotr Nyczyk, Jürgen Müller, Torsten Hoefler:
Psychologically Enhanced AI Agents. CoRR abs/2509.04343 (2025)
[i208]Pedro García López, Daniel Barcelona Pons, Marcin Copik, Torsten Hoefler, Eduardo Quiñones, Maciej Malawski, Peter Pietzutch, Alberto P. Martí, Thomas Ohlson Timoudas, Aleksander Slominski:
AI Factories: It's time to rethink the Cloud-HPC divide. CoRR abs/2509.12849 (2025)
[i207]Marcin Copik, Eiman Alnuaimi, Alok Kamatar, Valérie Hayot-Sasson, Alberto Madonna, Todd Gamblin, Kyle Chard, Ian T. Foster, Torsten Hoefler:
XaaS Containers: Performance-Portable Representation With Source and IR Containers. CoRR abs/2509.17914 (2025)
[i206]Marcin Chrapek, Marcin Copik, Etienne Mettaz, Torsten Hoefler:
Confidential LLM Inference: Performance and Cost Across CPU and GPU TEEs. CoRR abs/2509.18886 (2025)
[i205]Chang Chen, Tiancheng Chen, Jiangfei Duan, Qianchao Zhu, Zerui Wang, Qinghao Hu, Peng Sun, Xiuhong Li, Chao Yang, Torsten Hoefler:
Zeppelin: Balancing Variable-length Workloads in Data Parallel Large Model Training. CoRR abs/2509.21841 (2025)
[i204]Vage Egiazarian, Roberto L. Castro, Denis Kuznedelev, Andrei Panferov, Eldar Kurtic, Shubhra Pandit, Alexandre Noll Marques, Mark Kurtz, Saleh Ashkboos, Torsten Hoefler, Dan Alistarh:
Bridging the Gap Between Promise and Performance for Microscaling FP4 Quantization. CoRR abs/2509.23202 (2025)
[i203]Georgios Vlassis, Saleh Ashkboos, Alexandra Volkova, Torsten Hoefler, Dan Alistarh:
Beyond Outliers: A Study of Optimizers Under Quantization. CoRR abs/2509.23500 (2025)
[i202]Yavuz Durmazkeser, Patrik Okanovic, Andreas Kirsch, Torsten Hoefler, Nezihe Merve Gürel:
Active Model Selection for Large Language Models. CoRR abs/2510.09418 (2025)
[i201]Tommaso Bonato, Sepehr Abdous, Abdul Kabbani, Ahmad Ghalayini, Nadeen Gebara, Terry Lam, Anup Agarwal, Tiancheng Chen, Zhuolong Yu, Konstantin Taranov, Mahmoud Elhaddad, Daniele De Sensi, Soudeh Ghorbani, Torsten Hoefler:
Uno: A One-Stop Solution for Inter- and Intra-Datacenter Congestion Control and Reliable Connectivity. CoRR abs/2510.15802 (2025)
[i200]Marcin Chrapek, Meni Orenbach, Ahmad Atamli, Marcin Copik, Fritz Alder, Torsten Hoefler:
sNVMe-oF: Secure and Efficient Disaggregated Storage. CoRR abs/2510.18756 (2025)
[i199]Langwen Huang, Luigi Fusco, Florian Scheidl, Jan Zibell, Michael Armand Sprenger, Sebastian Schemm
, Torsten Hoefler:
Error bounded compression for weather and climate applications. CoRR abs/2510.22265 (2025)
[i198]Drago Plecko, Patrik Okanovic, Torsten Hoefler, Elias Bareinboim:
Epidemiology of Large Language Models: A Benchmark for Observational Distribution Knowledge. CoRR abs/2511.03070 (2025)
[i197]Andrei Ivanov, Siyuan Shen, Gioele Gottardo, Marcin Chrapek, Afif Boudaoud, Timo Schneider, Luca Benini, Torsten Hoefler:
PerfDojo: Automated ML Library Generation for Heterogeneous Architectures. CoRR abs/2511.03586 (2025)
[i196]Philipp Schaad, Tal Ben-Nun, Torsten Hoefler:
VEIL: Reading Control Flow Graphs Like Code. CoRR abs/2511.05066 (2025)
[i195]Philipp Schaad, Tal Ben-Nun, Patrick Iff, Torsten Hoefler:
Inductive Loop Analysis for Practical HPC Application Optimization. CoRR abs/2511.06052 (2025)
[i194]Lukas Gianinazzi, Tal Ben-Nun, Torsten Hoefler:
SPADA: A Spatial Dataflow Architecture Programming Language. CoRR abs/2511.09447 (2025)
[i193]Jiale Chen
, Vage Egiazarian, Torsten Hoefler, Dan Alistarh:
WUSH: Near-Optimal Adaptive Transforms for LLM Quantization. CoRR abs/2512.00956 (2025)
[i192]Siyuan Shen, Mikhail Khalilov, Lukas Gianinazzi, Timo Schneider, Marcin Chrapek, Jai Dayal, Manisha Gajbe, Robert W. Wisniewski, Torsten Hoefler:
EDAN: Towards Understanding Memory Parallelism and Latency Sensitivity in HPC. CoRR abs/2512.13176 (2025)
[i191]Aofeng Shen, Chi Zhang, Yakup Budanaz, Alexandru Calotoiu, Torsten Hoefler, Luca Benini:
Design in Tiles: Automating GEMM Deployment on Tile-Based Many-PE Accelerators. CoRR abs/2512.13638 (2025)
[i190]Paul Bagourd, Julian Jang-Jaccard, Vincent Lenders, Alain Mermoud, Torsten Hoefler, Cornelius Hempel:
Practical Challenges in Executing Shor's Algorithm on Existing Quantum Platforms. CoRR abs/2512.15330 (2025)- 2024
[j71]Torsten Hoefler, Tommaso Bonoto, Daniele De Sensi, Salvatore Di Girolamo, Shigang Li, Marco Heddes, Deepak Goel, Miguel Castro, Steve Scott:
HammingMesh: A Network Topology for Large-Scale Deep Learning. Commun. ACM 67(12): 97-105 (2024)
[j70]Torsten Hoefler
, Marcin Copik
, Pete Beckman
, Andrew Jones
, Ian T. Foster
, Manish Parashar
, Daniel A. Reed
, Matthias Troyer
, Thomas C. Schulthess
, Dan Ernst
, Jack J. Dongarra
:
XaaS: Acceleration as a Service to Enable Productive High-Performance Cloud Computing. Comput. Sci. Eng. 26(3): 40-51 (2024)
[j69]Maciej Besta
, Robert Gerstenberger
, Emanuel Peter
, Marc Fischer
, Michal Podstawski
, Claude Barthels
, Gustavo Alonso
, Torsten Hoefler
:
Demystifying Graph Databases: Analysis and Taxonomy of Data Organization, System Designs, and Graph Queries. ACM Comput. Surv. 56(2): 31:1-31:40 (2024)
[j68]Daniele De Sensi
, Edgar Costa Molero
, Salvatore Di Girolamo
, Laurent Vanbever, Torsten Hoefler:
Canary: Congestion-aware in-network allreduce using dynamic trees. Future Gener. Comput. Syst. 152: 70-82 (2024)
[j67]María Engracia Gómez
, Julio Sahuquillo, Andrea Biagioni, Nikos Chrysos, Damien Berton, Ottorino Frezza, Francesca Lo Cicero, Alessandro Lonardo
, Michele Martinelli, Pier Stanislao Paolucci
, Elena Pastorelli, Francesco Simula, Matteo Turisini, Piero Vicini
, Roberto Ammendola, Carlotta Chiarini, Chiara De Luca, Fabrizio Capuani, Adrián Castelló, Jose Duro, Eugenio Stabile, Enrique S. Quintana-Ortí, Pascale Bernier-Bruna, Claire Chen, Pierre-Axel Lagadec, Gregoire Pichon, Etienne Walter, Manolis Katevenis, Sokratis Bartzis, Orestis Mousouros, Pantelis Xirouchakis, Vangelis Mageiropoulos, Michalis Gianioudis, Harisis Loukas, Aggelos Ioannou, Nikos Kallimanis, Miguel Sánchez de la Rosa, Gabriel Gomez-Lopez
, Francisco Alfaro-Cortés, Jesús Escudero-Sahuquillo, Pedro Javier García, Francisco J. Quiles, José L. Sánchez, Gaetan De Gassowski, Matthieu Hautreaux, Stephane Mathieu, Gilles Moreau, Marc Pérache, Hugo Taboada, Torsten Hoefler, Timo Schneider, Matteo Barnaba, Giuseppe Piero Brandino, Francesco De Giorgi, Matteo Poggi, Iakovos Mavroidis, Yannis Papaefstathiou, Nikolaos Tampouratzis
, Benjamin Kalisch, Ulrich Krackhardt, Mondrian Nuessle, Wolfgang Frings, Dominik Gottwald, Felime Guimaraes, Max Holicki, Volker Marx, Yannik Müller, Carsten Clauss
, Hugo Falter, Xu Huang, Jennifer Lopez Barillao, Thomas Moschny, Simon Pickartz:
RED-SEA Project: Towards a new-generation European interconnect. Microprocess. Microsystems 110: 105102 (2024)
[j66]Peter Bauer
, Torsten Hoefler
, Bjorn Stevens
, Wilco Hazeleger
:
Digital twins of Earth and the computing challenge of human interaction. Nat. Comput. Sci. 4(3): 154-157 (2024)
[j65]Maciej Besta
, Torsten Hoefler
:
Parallel and Distributed Graph Neural Networks: An In-Depth Concurrency Analysis. IEEE Trans. Pattern Anal. Mach. Intell. 46(5): 2584-2606 (2024)
[j64]Wenqi Jiang, Marco Zeller, Roger Waleffe, Torsten Hoefler, Gustavo Alonso:
Chameleon: a Heterogeneous and Disaggregated Accelerator System for Retrieval-Augmented Language Models. Proc. VLDB Endow. 18(1): 42-52 (2024)
[j63]Thomas Benz
, Michael Rogenmoser
, Paul Scheffler
, Samuel Riedel
, Alessandro Ottaviano
, Andreas Kurth
, Torsten Hoefler
, Luca Benini
:
A High-Performance, Energy-Efficient Modular DMA Engine Architecture. IEEE Trans. Computers 73(1): 263-277 (2024)
[j62]Jinfan Chen
, Shigang Li
, Ran Guo
, Jinhui Yuan
, Torsten Hoefler
:
AutoDDL: Automatic Distributed Deep Learning With Near-Optimal Bandwidth Cost. IEEE Trans. Parallel Distributed Syst. 35(8): 1331-1344 (2024)
[c285]Maciej Besta, Nils Blach, Ales Kubicek, Robert Gerstenberger, Michal Podstawski, Lukas Gianinazzi, Joanna Gajda, Tomasz Lehmann
, Hubert Niewiadomski, Piotr Nyczyk, Torsten Hoefler:
Graph of Thoughts: Solving Elaborate Problems with Large Language Models. AAAI 2024: 17682-17690
[c284]Marcin Copik
, Alexandru Calotoiu
, Gyorgy Réthy
, Roman Böhringer
, Rodrigo Bruno
, Torsten Hoefler
:
Process-as-a-Service: Unifying Elastic and Stateful Clouds with Serverless Processes. SoCC 2024: 223-242
[c283]Eldar Kurtic, Torsten Hoefler, Dan Alistarh:
How to Prune Your Language Model: Recovering Accuracy on the "Sparsity May Cry" Benchmark. CPAL 2024: 542-553
[c282]Samuel Riedel, Marc Gantenbein, Alessandro Ottaviano, Torsten Hoefler, Luca Benini:
LRSCwait: Enabling Scalable and Efficient Synchronization in Manycore Systems Through Polling-Free and Retry-Free Operation. DATE 2024: 1-6
[c281]Saleh Ashkboos, Ilia Markov, Elias Frantar, Tingxuan Zhong, Xincheng Wang, Jie Ren, Torsten Hoefler, Dan Alistarh:
QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models. EMNLP 2024: 3355-3371
[c280]Marcin Copik
, Alexandru Calotoiu
, Pengyu Zhou
, Konstantin Taranov
, Torsten Hoefler
:
FaaSKeeper: Learning from Building Serverless Services with ZooKeeper as an Example. HPDC 2024: 94-108
[c279]Piotr Luczynski
, Lukas Gianinazzi
, Patrick Iff
, Leighton Wilson
, Daniele De Sensi
, Torsten Hoefler
:
Near-Optimal Wafer-Scale Reduce. HPDC 2024: 334-347
[c278]Luca Bertaccini, Siyuan Shen, Torsten Hoefler, Luca Benini:
Extending RISC-V for Efficient Overflow Recovery in Mixed-Precision Computations. ICCD 2024: 268-275
[c277]Saleh Ashkboos, Maximilian L. Croci, Marcelo Gennari Do Nascimento, Torsten Hoefler, James Hensman:
SliceGPT: Compress Large Language Models by Deleting Rows and Columns. ICLR 2024
[c276]Tim Dettmers, Ruslan Svirschevski, Vage Egiazarian, Denis Kuznedelev, Elias Frantar, Saleh Ashkboos, Alexander Borzunov, Torsten Hoefler, Dan Alistarh:
SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression. ICLR 2024
[c275]Langwen Huang, Lukas Gianinazzi, Yuejiang Yu, Peter D. Düben, Torsten Hoefler:
DiffDA: a Diffusion model for weather-scale Data Assimilation. ICML 2024: 19798-19815
[c274]Marcin Copik, Marcin Chrapek, Larissa Schmid, Alexandru Calotoiu, Torsten Hoefler:
Software Resource Disaggregation for HPC with Serverless Computing. IPDPS 2024: 139-156
[c273]Yves Baumann, Tal Ben-Nun, Maciej Besta, Lukas Gianinazzi, Torsten Hoefler, Piotr Luczynski:
Low-Depth Spatial Tree Algorithms. IPDPS 2024: 180-192
[c272]Saleh Ashkboos, Amirkeivan Mohtashami, Maximilian L. Croci, Bo Li, Pashmina Cameron, Martin Jaggi, Dan Alistarh, Torsten Hoefler, James Hensman:
QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs. NeurIPS 2024
[c271]Nils Blach, Maciej Besta, Daniele De Sensi, Jens Domke, Hussein Harake, Shigang Li, Patrick Iff, Marek Konieczny, Kartik Lakhotia, Ales Kubicek, Marcel Ferrari, Fabrizio Petrini, Torsten Hoefler:
A High-Performance Design, Implementation, Deployment, and Evaluation of The Slim Fly Network. NSDI 2024
[c270]Daniele De Sensi, Tommaso Bonato, David Saam, Torsten Hoefler:
Swing: Short-cutting Rings for Higher Bandwidth Allreduce. NSDI 2024
[c269]Lukas Gianinazzi
, Alexandros Nikolaos Ziogas
, Langwen Huang
, Piotr Luczynski
, Saleh Ashkboosh
, Florian Scheidl
, Armon Carigiet
, Chio Ge
, Nabil Abubaker
, Maciej Besta
, Tal Ben-Nun
, Torsten Hoefler
:
Arrow Matrix Decomposition: A Novel Approach for Communication-Efficient Sparse Matrix Multiplication. PPoPP 2024: 404-416
[c268]Jerónimo Sánchez García
, Salvatore Di Girolamo, Sokol Kosta
, J. J. Vegas Olmos, Rami Nudelman, Torsten Hoefler, Gil Bloch:
Offloaded MPI message matching: an optimistic approach. SC Workshops 2024: 457-469
[c267]Mikhail Khalilov, Salvatore Di Girolamo, Marcin Chrapek, Rami Nudelman, Gil Bloch, Torsten Hoefler:
Network-Offloaded Bandwidth-Optimal Broadcast and Allgather for Distributed AI. SC 2024: Article 103
[c266]Patrik Okanovic, Grzegorz Kwasniewski, Paolo Sylos Labini, Maciej Besta, Flavio Vella
, Torsten Hoefler:
High Performance Unstructured SpMM Computation Using Tensor Cores. SC 2024: Article 54
[c265]Daniele De Sensi, Lorenzo Pichetti, Flavio Vella
, Tiziano De Matteis
, Zebin Ren
, Luigi Fusco, Matteo Turisini, Daniele Cesarini, Kurt Lust, Animesh Trivedi, Duncan Roweth, Filippo Spiga, Salvatore Di Girolamo, Torsten Hoefler:
Exploring GPU-to-GPU Communication: Insights into Supercomputer Interconnects. SC 2024: Article 33
[c264]Siyuan Shen, Langwen Huang, Marcin Chrapek, Timo Schneider, Jai Dayal, Manisha Gajbe, Robert W. Wisniewski, Torsten Hoefler:
LLAMP: Assessing Network Latency Tolerance of HPC Applications with Linear Programming. SC 2024: Article 64
[c263]Kartik Lakhotia
, Laura Monroe
, Kelly Isham
, Maciej Besta
, Nils Blach
, Torsten Hoefler
, Fabrizio Petrini
:
PolarStar: Expanding the Horizon of Diameter-3 Networks. SPAA 2024: 345-357
[c262]Mikhail Khalilov, Marcin Chrapek, Siyuan Shen, Alessandro Vezzu, Thomas Benz, Salvatore Di Girolamo, Timo Schneider, Daniele De Sensi, Luca Benini, Torsten Hoefler:
OSMOSIS: Enabling Multi-Tenancy in Datacenter SmartNICs. USENIX ATC 2024: 247-263
[d5]Elias Frantar
, Roberto L. Castro
, Jiale Chen
, Torsten Hoefler
, Dan Alistarh
:
MARLIN: Mixed-Precision Auto-Regressive Parallel Inference on Large Language Models. Zenodo, 2024
[i189]Torsten Hoefler, Marcin Copik
, Pete Beckman, Andrew Jones
, Ian T. Foster, Manish Parashar, Daniel A. Reed, Matthias Troyer, Thomas C. Schulthess, Dan Ernst, Jack J. Dongarra:
XaaS: Acceleration as a Service to Enable Productive High-Performance Cloud Computing. CoRR abs/2401.04552 (2024)
[i188]Langwen Huang, Lukas Gianinazzi, Yuejiang Yu, Peter D. Düben, Torsten Hoefler:
DiffDA: a diffusion model for weather-scale data assimilation. CoRR abs/2401.05932 (2024)
[i187]Daniele De Sensi, Tommaso Bonato, David Saam, Torsten Hoefler:
Swing: Short-cutting Rings for Higher Bandwidth Allreduce. CoRR abs/2401.09356 (2024)
[i186]Samuel Riedel, Marc Gantenbein, Alessandro Ottaviano, Torsten Hoefler, Luca Benini:
LRSCwait: Enabling Scalable and Efficient Synchronization in Manycore Systems through Polling-Free and Retry-Free Operation. CoRR abs/2401.09359 (2024)
[i185]Lukas Möller, Marcin Copik
, Alexandru Calotoiu, Torsten Hoefler:
Cppless: Productive and Performant Serverless Programming in C++. CoRR abs/2401.10834 (2024)
[i184]Marcin Copik, Marcin Chrapek, Larissa Schmid, Alexandru Calotoiu, Torsten Hoefler:
Software Resource Disaggregation for HPC with Serverless Computing. CoRR abs/2401.10852 (2024)
[i183]Maciej Besta, Florim Memedi, Zhenyu Zhang, Robert Gerstenberger, Nils Blach, Piotr Nyczyk, Marcin Copik
, Grzegorz Kwasniewski, Jürgen Müller, Lukas Gianinazzi, Ales Kubicek, Hubert Niewiadomski, Onur Mutlu
, Torsten Hoefler:
Topologies of Reasoning: Demystifying Chains, Trees, and Graphs of Thoughts. CoRR abs/2401.14295 (2024)
[i182]Saleh Ashkboos, Maximilian L. Croci, Marcelo Gennari Do Nascimento, Torsten Hoefler, James Hensman:
SliceGPT: Compress Large Language Models by Deleting Rows and Columns. CoRR abs/2401.15024 (2024)
[i181]Lukas Gianinazzi, Alexandros Nikolaos Ziogas, Langwen Huang, Piotr Luczynski, Saleh Ashkboos, Florian Scheidl, Armon Carigiet, Chio Ge, Nabil Abubaker, Maciej Besta, Tal Ben-Nun, Torsten Hoefler:
Arrow Matrix Decomposition: A Novel Approach for Communication-Efficient Sparse Matrix Multiplication. CoRR abs/2402.19364 (2024)
[i180]Saleh Ashkboos, Amirkeivan Mohtashami, Maximilian L. Croci, Bo Li, Martin Jaggi, Dan Alistarh, Torsten Hoefler, James Hensman:
QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs. CoRR abs/2404.00456 (2024)
[i179]Tommaso Bonato, Abdul Kabbani, Daniele De Sensi, Rong Pan, Yanfang Le, Costin Raiciu, Mark Handley, Timo Schneider, Nils Blach, Ahmad Ghalayini
, Daniel S. F. Alves, Michael Papamichael, Adrian M. Caulfield, Torsten Hoefler:
SMaRTT-REPS: Sender-based Marked Rapidly-adapting Trimmed & Timed Transport with Recycled Entropies. CoRR abs/2404.01630 (2024)
[i178]Yves Baumann, Tal Ben-Nun, Maciej Besta, Lukas Gianinazzi, Torsten Hoefler, Piotr Luczynski:
Low-Depth Spatial Tree Algorithms. CoRR abs/2404.12953 (2024)
[i177]Siyuan Shen, Langwen Huang, Marcin Chrapek, Timo Schneider, Jai Dayal, Manisha Gajbe, Robert W. Wisniewski, Torsten Hoefler:
LLAMP: Assessing Network Latency Tolerance of HPC Applications with Linear Programming. CoRR abs/2404.14193 (2024)
[i176]Piotr Luczynski, Lukas Gianinazzi, Patrick Iff, Leighton Wilson, Daniele De Sensi, Torsten Hoefler:
Near-Optimal Wafer-Scale Reduce. CoRR abs/2404.15888 (2024)
[i175]Nabil Abubaker, Torsten Hoefler:
SpComm3D: A Framework for Enabling Sparse Communication in 3D Sparse Kernels. CoRR abs/2404.19638 (2024)
[i174]Torsten Hoefler, Alexandru Calotoiu, Anurag Dipankar
, Thomas C. Schulthess, Xavier Lapillonne, Oliver Fuhrer:
Towards Specialized Supercomputers for Climate Sciences: Computational Requirements of the Icosahedral Nonhydrostatic Weather and Climate Model. CoRR abs/2405.13043 (2024)
[i173]Timo Schneider, Pengcheng Xu
, Torsten Hoefler:
FPsPIN: An FPGA-based Open-Hardware Research Platform for Processing in the Network. CoRR abs/2405.16378 (2024)
[i172]Maciej Besta, Lorenzo Paleari
, Ales Kubicek, Piotr Nyczyk, Robert Gerstenberger, Patrick Iff, Tomasz Lehmann, Hubert Niewiadomski, Torsten Hoefler:
CheckEmbed: Effective Verification of LLM Solutions to Open-Ended Tasks. CoRR abs/2406.02524 (2024)
[i171]Maciej Besta, Ales Kubicek, Roman Niggli, Robert Gerstenberger, Lucas Weitzendorf, Mingyuan Chi, Patrick Iff, Joanna Gajda, Piotr Nyczyk, Jürgen Müller, Hubert Niewiadomski, Marcin Chrapek, Michal Podstawski
, Torsten Hoefler:
Multi-Head RAG: Solving Multi-Aspect Problems with LLMs. CoRR abs/2406.05085 (2024)
[i170]Wenqi Jiang, Hang Hu, Torsten Hoefler, Gustavo Alonso:
Accelerating Graph-based Vector Search via Delayed-Synchronization Traversal. CoRR abs/2406.12385 (2024)
[i169]Maciej Besta, Florian Scheidl, Lukas Gianinazzi, Shachar Klaiman, Jürgen Müller, Torsten Hoefler:
Demystifying Higher-Order Graph Neural Networks. CoRR abs/2406.12841 (2024)
[i168]Tommaso Bonato, Abdul Kabbani, Ahmad Ghalayini
, Mohammad Dohadwala, Michael Papamichael, Daniele De Sensi, Torsten Hoefler:
REPS: Recycling Entropies for Packet Spraying to Adaptively Explore Paths and Mitigate Failures. CoRR abs/2407.21625 (2024)
[i167]Patrik Okanovic, Grzegorz Kwasniewski, Paolo Sylos Labini, Maciej Besta, Flavio Vella, Torsten Hoefler:
High Performance Unstructured SpMM Computation Using Tensor Cores. CoRR abs/2408.11551 (2024)
[i166]Luigi Fusco, Mikhail Khalilov, Marcin Chrapek, Giridhar Chukkapalli, Thomas C. Schulthess
, Torsten Hoefler:
Understanding Data Movement in Tightly Coupled Heterogeneous Systems: A Case Study with the Grace Hopper Superchip. CoRR abs/2408.11556 (2024)
[i165]Elias Frantar, Roberto L. Castro, Jiale Chen
, Torsten Hoefler, Dan Alistarh:
MARLIN: Mixed-Precision Auto-Regressive Parallel Inference on Large Language Models. CoRR abs/2408.11743 (2024)
[i164]Maciej Besta, Robert Gerstenberger, Patrick Iff, Pournima Sonawane, Juan Gómez-Luna, Raghavendra Kanakagiri
, Rui Min, Onur Mutlu
, Torsten Hoefler, Raja Appuswamy, Aidan O'Mahony:
Hardware Acceleration for Knowledge Graph Processing: Challenges & Recent Developments. CoRR abs/2408.12173 (2024)
[i163]Mikhail Khalilov, Salvatore Di Girolamo, Marcin Chrapek, Rami Nudelman, Gil Bloch, Torsten Hoefler:
Network-Offloaded Bandwidth-Optimal Broadcast and Allgather for Distributed AI. CoRR abs/2408.13356 (2024)
[i162]Daniele De Sensi, Lorenzo Pichetti, Flavio Vella, Tiziano De Matteis, Zebin Ren, Luigi Fusco, Matteo Turisini, Daniele Cesarini, Kurt Lust, Animesh Trivedi, Duncan Roweth, Filippo Spiga, Salvatore Di Girolamo, Torsten Hoefler:
Exploring GPU-to-GPU Communication: Insights into Supercomputer Interconnects. CoRR abs/2408.14090 (2024)
[i161]Larissa Schmid, Marcin Copik, Alexandru Calotoiu, Laurin Brandner, Anne Koziolek, Torsten Hoefler:
SeBS-Flow: Benchmarking Serverless Cloud Function Workflows. CoRR abs/2410.03480 (2024)
[i160]Marcin Chrapek, Anjo Vahldiek-Oberwagner, Marcin Spoczynski
, Scott Constable, Mona Vij, Torsten Hoefler:
Fortify Your Foundations: Practical Privacy and Security for Foundation Model Deployments In The Cloud. CoRR abs/2410.05930 (2024)
[i159]Patrik Okanovic, Andreas Kirsch, Jannes Kasper, Torsten Hoefler, Andreas Krause, Nezihe Merve Gürel:
All models are wrong, some are useful: Model Selection with Limited Labels. CoRR abs/2410.13609 (2024)
[i158]Saleh Ashkboos, Bram Verhoef, Torsten Hoefler, Evangelos Eleftheriou, Martino Dazzi:
EfQAT: An Efficient Framework for Quantization-Aware Training. CoRR abs/2411.11038 (2024)
[i157]Lukas Trümper, Philipp Schaad, Berke Ates, Alexandru Calotoiu, Marcin Copik, Torsten Hoefler:
A Priori Loop Nest Normalization: Automatic Loop Scheduling in Complex Applications. CoRR abs/2412.20179 (2024)- 2023
[j61]Torsten Hoefler, Thomas Häner, Matthias Troyer:
Disentangling Hype from Practicality: On Realistically Achieving Quantum Advantage. Commun. ACM 66(5): 82-87 (2023)
[j60]Torsten Hoefler
, Duncan Roweth, Keith D. Underwood, Robert Alverson, Mark Griswold, Vahid Tabatabaee, Mohan Kalkunte, Surendra Anubolu, Siyuan Shen, Moray McLaren, Abdul Kabbani, Steve Scott:
Data Center Ethernet and Remote Direct Memory Access: Issues at Hyperscale. Computer 56(7): 67-77 (2023)
[j59]Torsten Hoefler
, Bjorn Stevens
, Andreas F. Prein
, Johanna Baehr
, Thomas C. Schulthess
, Thomas F. Stocker
, John A. Taylor
, Daniel Klocke
, Pekka Manninen, Piers M. Forster
, Tobias Kölling, Nicolas Gruber
, Hartwig Anzt, Claudia Frauen
, Florian Ziemen
, Milan Klöwer
, Karthik Kashinath, Christoph M. Schär, Oliver Fuhrer, Bryan N. Lawrence
:
Earth Virtualization Engines: A Technical Perspective. Comput. Sci. Eng. 25(3): 50-59 (2023)
[j58]Satoshi Matsuoka
, Jens Domke
, Mohamed Wahib
, Aleksandr Drozd
, Torsten Hoefler
:
Myths and legends in high-performance computing. Int. J. High Perform. Comput. Appl. 37(3-4): 245-259 (2023)
[j57]Maciej Besta
, Marc Fischer, Vasiliki Kalavri
, Michael Kapralov
, Torsten Hoefler
:
Practice of Streaming Processing of Dynamic Graphs: Concepts, Models, and Systems. IEEE Trans. Parallel Distributed Syst. 34(6): 1860-1876 (2023)
[j56]Paul Scheffler
, Florian Zaruba
, Fabian Schuiki
, Torsten Hoefler
, Luca Benini
:
Sparse Stream Semantic Registers: A Lightweight ISA Extension Accelerating General Sparse Linear Algebra. IEEE Trans. Parallel Distributed Syst. 34(12): 3147-3161 (2023)
[c261]Wei Qiu, Marcin Copik
, Yun Wang
, Alexandru Calotoiu, Torsten Hoefler:
User-guided Page Merging for Memory Deduplication in Serverless Systems. IEEE Big Data 2023: 159-169
[c260]Tal Ben-Nun, Berke Ates
, Alexandru Calotoiu, Torsten Hoefler:
Bridging Control-Centric and Data-Centric Optimization. CGO 2023: 173-185
[c259]Tal Ben-Nun
, Lukas Gianinazzi
, Torsten Hoefler
, Yishai Oltchik:
Maximum Flows in Parametric Graph Templates. CIAC 2023: 97-111
[c258]Patrick Iff, Maciej Besta, Matheus A. Cavalcante, Tim Fischer, Luca Benini, Torsten Hoefler:
Sparse Hamming Graph: A Customizable Network-on-Chip Topology. DAC 2023: 1-6
[c257]Patrick Iff, Maciej Besta, Matheus A. Cavalcante, Tim Fischer, Luca Benini, Torsten Hoefler:
HexaMesh: Scaling to Hundreds of Chiplets with an Optimized Chiplet Arrangement. DAC 2023: 1-6
[c256]Tiziano De Matteis
, Lukas Gianinazzi
, Johannes de Fine Licht
, Torsten Hoefler
:
Streaming Task Graph Scheduling for Dataflow Architectures. HPDC 2023: 225-237
[c255]Yunqiang Li, Jan C. van Gemert, Torsten Hoefler, Bert Moons, Evangelos Eleftheriou, Bram-Ernst Verhoef:
Differentiable Transportation Pruning. ICCV 2023: 16911-16921
[c254]Elias Frantar, Saleh Ashkboos, Torsten Hoefler, Dan Alistarh:
OPTQ: Accurate Quantization for Generative Pre-trained Transformers. ICLR 2023
[c253]Langwen Huang, Torsten Hoefler:
Compressing multidimensional weather and climate data into neural networks. ICLR 2023
[c252]Lukas Trümper
, Tal Ben-Nun
, Philipp Schaad
, Alexandru Calotoiu
, Torsten Hoefler
:
Performance Embeddings: A Similarity-Based Transfer Tuning Approach to Performance Optimization. ICS 2023: 50-62
[c251]Marcin Copik
, Roman Böhringer
, Alexandru Calotoiu
, Torsten Hoefler
:
FMI: Fast and Cheap Message Passing for Serverless Functions. ICS 2023: 373-385
[c250]Marcin Copik
, Konstantin Taranov, Alexandru Calotoiu, Torsten Hoefler:
rFaaS: Enabling High Performance Serverless with RDMA and Leases. IPDPS 2023: 897-907
[c249]Maciej Besta, Afonso Claudino Catarino, Lukas Gianinazzi, Nils Blach, Piotr Nyczyk, Hubert Niewiadomski, Torsten Hoefler:
HOT: Higher-Order Dynamic Graph Representation Learning With Efficient Transformers. LoG 2023: 15
[c248]Kazuki Osawa, Shigang Li, Torsten Hoefler:
PipeFisher: Efficient Training of Large Language Models Using Pipelining and Fisher Information Matrices. MLSys 2023
[c247]Tommy Nguyen, Yue Shi, Samuel A. Stein, Tim Stavenger, Marvin Warner, Martin Roetteler, Torsten Hoefler, Ang Li:
A Reference Implementation for a Quantum Message Passing Interface. QCE 2023: 292-293
[c246]Maciej Besta
, Robert Gerstenberger
, Marc Fischer
, Michal Podstawski
, Nils Blach
, Berke Egeli
, George Mitenkov
, Wojciech Chlapek
, Marek T. Michalewicz
, Hubert Niewiadomski
, Jürgen Müller, Torsten Hoefler
:
The Graph Database Interface: Scaling Online Transactional and Analytical Graph Workloads to Hundreds of Thousands of Cores. SC 2023: 22:1-22:18
[c245]Marcin Chrapek
, Mikhail Khalilov
, Torsten Hoefler
:
HEAR: Homomorphically Encrypted Allreduce. SC 2023: 36:1-36:17
[c244]Maciej Besta
, Pawel Renc
, Robert Gerstenberger
, Paolo Sylos Labini
, Alexandros Nikolaos Ziogas
, Tiancheng Chen
, Lukas Gianinazzi
, Florian Scheidl
, Kalman Szenes
, Armon Carigiet
, Patrick Iff
, Grzegorz Kwasniewski
, Raghavendra Kanakagiri
, Chio Ge
, Sammy Jaeger
, Jaroslaw Was
, Flavio Vella
, Torsten Hoefler
:
High-Performance and Programmable Attentional Graph Neural Networks with Global Tensor Formulations. SC 2023: 66:1-66:16
[c243]Roberto L. Castro
, Andrei Ivanov
, Diego Andrade
, Tal Ben-Nun
, Basilio B. Fraguela
, Torsten Hoefler
:
VENOM: A Vectorized N: M Format for Unleashing the Power of Sparse Tensor Cores. SC 2023: 72:1-72:14
[c242]Wenqi Jiang
, Shigang Li
, Yu Zhu
, Johannes de Fine Licht
, Zhenhao He
, Runbin Shi
, Cédric Renggli, Shuai Zhang
, Theodoros Rekatsinas
, Torsten Hoefler
, Gustavo Alonso
:
Co-design Hardware and Algorithm for Vector Search. SC 2023: 87:1-87:15
[c241]Philipp Schaad
, Timo Schneider
, Tal Ben-Nun
, Alexandru Calotoiu
, Alexandros Nikolaos Ziogas
, Torsten Hoefler
:
FuzzyFlow: Leveraging Dataflow To Find and Squash Program Optimization Bugs. SC 2023: 88:1-88:15
[c240]Yue Shi
, Tommy Nguyen
, Samuel A. Stein, Tim Stavenger
, Marvin Warner
, Martin Roetteler
, Torsten Hoefler
, Ang Li
:
A Reference Implementation for a Quantum Message Passing Interface. SC Workshops 2023: 1420-1425
[c239]Daniele De Sensi
, Tiziano De Matteis
, Konstantin Taranov
, Salvatore Di Girolamo
, Tobias Rahn
, Torsten Hoefler
:
Noise in the Clouds: Influence of Network Performance Variability on Application Scalability. SIGMETRICS (Abstracts) 2023: 17-18
[c238]Kartik Lakhotia
, Kelly Isham
, Laura Monroe
, Maciej Besta
, Torsten Hoefler
, Fabrizio Petrini
:
In-network Allreduce with Multiple Spanning Trees on PolarFly. SPAA 2023: 165-176
[c237]Andrei Ivanov, Benjamin Rothenberger, Arnaud Dethise, Marco Canini, Torsten Hoefler, Adrian Perrig:
SAGE: Software-based Attestation for GPU Execution. USENIX ATC 2023: 485-499
[d4]Maciej Besta
, Robert Gerstenberger
, Marc Fischer
, Michal Podstawski
, Jürgen Müller
, Nils Blach
, Berke Egeli
, George Mitenkov
, Marek T. Michalewicz
, Torsten Hoefler
:
GDI-RMA 0.1 Software Artifact. Zenodo, 2023
[d3]Maciej Besta, Pawel Renc
, Robert Gerstenberger
, Paolo Sylos Labini
, Alexandros Nikolaos Ziogas
, Tiancheng Chen, Lukas Gianinazzi
, Florian Scheidl
, Kalman Szenes
, Armon Carigiet
, Patrick Iff
, Grzegorz Kwasniewski
, Raghavendra Kanakagiri
, Chio Ge
, Sammy Jaeger, Jaroslaw Was
, Flavio Vella
, Torsten Hoefler
:
GNN Scaling 0.1 Software Artifact. Zenodo, 2023
[d2]Lukas Gianinazzi
, Alexandros Nikolaos Ziogas
, Piotr Luczynski
, Saleh Ashkboosh
, Langwen Huang
, Florian Scheidl
, Chio Ge
, Armon Carigiet
, Maciej Besta
, Tal Ben-Nun
, Torsten Hoefler
:
Arrow Matrix Decompositions. Zenodo, 2023
[d1]Marcus Ritter
, Alexandru Calotoiu, Sebastian Rinke, Thorsten Reimann, Torsten Hoefler, Felix Wolf
:
Performance Measurement Dataset of the HPC Benchmarks FASTEST, Kripke, LULESH, MiniFE, Quicksilver, and RELeARN for Scalability Studies with Extra-P. Zenodo, 2023
[i156]Niels Gleinig, Tal Ben-Nun, Torsten Hoefler:
A Theory of I/O-Efficient Sparse Neural Network Inference. CoRR abs/2301.01048 (2023)
[i155]Satoshi Matsuoka, Jens Domke, Mohamed Wahib, Aleksandr Drozd, Torsten Hoefler:
Myths and Legends in High-Performance Computing. CoRR abs/2301.02432 (2023)
[i154]Jinfan Chen, Shigang Li, Ran Guo, Jinhui Yuan, Torsten Hoefler:
AutoDDL: Automatic Distributed Deep Learning with Asymptotically Optimal Communication. CoRR abs/2301.06813 (2023)
[i153]Niels Gleinig, Tobias Rohner, Torsten Hoefler:
Approximate Reversible Circuits for NISQ-Era Quantum Computers. CoRR abs/2302.01066 (2023)
[i152]Torsten Hoefler, Duncan Roweth, Keith D. Underwood, Bob Alverson, Mark Griswold, Vahid Tabatabaee, Mohan Kalkunte, Surendra Anubolu, Siyuan Shen, Abdul Kabbani, Moray McLaren, Steve Scott:
Datacenter Ethernet and RDMA: Issues at Hyperscale. CoRR abs/2302.03337 (2023)
[i151]Kartik Lakhotia, Laura Monroe, Kelly Isham, Maciej Besta, Nils Blach, Torsten Hoefler, Fabrizio Petrini:
PolarStar: Expanding the Scalability Horizon of Diameter-3 Networks. CoRR abs/2302.07217 (2023)
[i150]Lukas Trümper, Tal Ben-Nun, Philipp Schaad, Alexandru Calotoiu, Torsten Hoefler:
Performance Embeddings: A Similarity-based Approach to Automatic Performance Optimization. CoRR abs/2303.08142 (2023)
[i149]Andrei Ivanov, Nikoli Dryden, Tal Ben-Nun, Saleh Ashkboos, Torsten Hoefler:
STen: Productive and Efficient Sparsity in PyTorch. CoRR abs/2304.07613 (2023)
[i148]Kazuki Osawa, Satoki Ishikawa, Rio Yokota, Shigang Li, Torsten Hoefler:
ASDL: A Unified Interface for Gradient Preconditioning in PyTorch. CoRR abs/2305.04684 (2023)
[i147]Thomas Benz, Michael Rogenmoser, Paul Scheffler, Samuel Riedel, Alessandro Ottaviano, Andreas Kurth, Torsten Hoefler, Luca Benini:
A High-performance, Energy-efficient Modular DMA Engine Architecture. CoRR abs/2305.05240 (2023)
[i146]Paul Scheffler, Florian Zaruba, Fabian Schuiki, Torsten Hoefler, Luca Benini:
Sparse Stream Semantic Registers: A Lightweight ISA Extension Accelerating General Sparse Linear Algebra. CoRR abs/2305.05559 (2023)
[i145]Marcin Copik, Roman Böhringer, Alexandru Calotoiu, Torsten Hoefler:
FMI: Fast and Cheap Message Passing for Serverless Functions. CoRR abs/2305.08763 (2023)
[i144]Maciej Besta, Robert Gerstenberger, Marc Fischer, Michal Podstawski, Jürgen Müller, Nils Blach, Berke Egeli, George Mitenkov, Wojciech Chlapek, Marek T. Michalewicz, Torsten Hoefler:
High-Performance Graph Databases That Are Portable, Programmable, and Scale to Hundreds of Thousands of Cores. CoRR abs/2305.11162 (2023)
[i143]Tal Ben-Nun, Berke Ates, Alexandru Calotoiu, Torsten Hoefler:
Bridging Control-Centric and Data-Centric Optimization. CoRR abs/2306.00366 (2023)
[i142]Tiziano De Matteis, Lukas Gianinazzi, Johannes de Fine Licht, Torsten Hoefler:
Streaming Task Graph Scheduling for Dataflow Architectures. CoRR abs/2306.02730 (2023)
[i141]Tim Dettmers, Ruslan Svirschevski, Vage Egiazarian, Denis Kuznedelev, Elias Frantar, Saleh Ashkboos, Alexander Borzunov, Torsten Hoefler, Dan Alistarh:
SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression. CoRR abs/2306.03078 (2023)
[i140]Wenqi Jiang, Shigang Li, Yu Zhu, Johannes de Fine Licht, Zhenhao He, Runbin Shi, Cédric Renggli, Shuai Zhang, Theodoros Rekatsinas, Torsten Hoefler, Gustavo Alonso:
Co-design Hardware and Algorithm for Vector Search. CoRR abs/2306.11182 (2023)
[i139]Philipp Schaad
, Timo Schneider, Tal Ben-Nun, Alexandru Calotoiu, Alexandros Nikolaos Ziogas, Torsten Hoefler:
FuzzyFlow: Leveraging Dataflow To Find and Squash Program Optimization Bugs. CoRR abs/2306.16178 (2023)
[i138]Torsten Hoefler, Thomas Häner, Matthias Troyer:
Disentangling Hype from Practicality: On Realistically Achieving Quantum Advantage. CoRR abs/2307.00523 (2023)
[i137]Tal Ben-Nun, Lukas Gianinazzi, Torsten Hoefler, Yishai Oltchik:
Maximum Flows in Parametric Graph Templates. CoRR abs/2307.08420 (2023)
[i136]Yunqiang Li, Jan C. van Gemert, Torsten Hoefler, Bert Moons, Evangelos Eleftheriou, Bram-Ernst Verhoef:
Differentiable Transportation Pruning. CoRR abs/2307.08483 (2023)
[i135]Maciej Besta, Nils Blach, Ales Kubicek, Robert Gerstenberger, Lukas Gianinazzi, Joanna Gajda, Tomasz Lehmann, Michal Podstawski
, Hubert Niewiadomski, Piotr Nyczyk, Torsten Hoefler:
Graph of Thoughts: Solving Elaborate Problems with Large Language Models. CoRR abs/2308.09687 (2023)
[i134]Julia Bazinska, Andrei Ivanov, Tal Ben-Nun, Nikoli Dryden, Maciej Besta, Siyuan Shen, Torsten Hoefler:
Cached Operator Reordering: A Unified View for Fast GNN Training. CoRR abs/2308.12093 (2023)
[i133]Mikhail Khalilov, Marcin Chrapek, Siyuan Shen, Alessandro Vezzu, Thomas Benz, Salvatore Di Girolamo, Timo Schneider, Daniele De Sensi, Luca Benini, Torsten Hoefler:
OSMOSIS: Enabling Multi-Tenancy in Datacenter SmartNICs. CoRR abs/2309.03628 (2023)
[i132]Torsten Hoefler, Bjorn Stevens, Andreas F. Prein, Johanna Baehr, Thomas C. Schulthess, Thomas F. Stocker, John A. Taylor
, Daniel Klocke, Pekka Manninen, Piers M. Forster
, Tobias Kölling, Nicolas Gruber, Hartwig Anzt, Claudia Frauen, Florian Ziemen, Milan Klöwer
, Karthik Kashinath, Christoph M. Schär, Oliver Fuhrer, Bryan N. Lawrence:
Earth Virtualization Engines - A Technical Perspective. CoRR abs/2309.09002 (2023)
[i131]Daniele De Sensi, Edgar Costa Molero, Salvatore Di Girolamo, Laurent Vanbever, Torsten Hoefler:
Canary: Congestion-Aware In-Network Allreduce Using Dynamic Trees. CoRR abs/2309.16214 (2023)
[i130]Roberto L. Castro, Andrei Ivanov, Diego Andrade, Tal Ben-Nun, Basilio B. Fraguela, Torsten Hoefler:
VENOM: A Vectorized N: M Format for Unleashing the Power of Sparse Tensor Cores. CoRR abs/2310.02065 (2023)
[i129]Nils Blach, Maciej Besta, Daniele De Sensi, Jens Domke, Hussein Harake, Shigang Li, Patrick Iff, Marek Konieczny, Kartik Lakhotia, Ales Kubicek, Marcel Ferrari, Fabrizio Petrini, Torsten Hoefler:
A High-Performance Design, Implementation, Deployment, and Evaluation of The Slim Fly Network. CoRR abs/2310.03742 (2023)
[i128]Saleh Ashkboos, Ilia Markov, Elias Frantar, Tingxuan Zhong, Xincheng Wang, Jie Ren, Torsten Hoefler, Dan Alistarh:
Towards End-to-end 4-Bit Inference on Generative Large Language Models. CoRR abs/2310.09259 (2023)
[i127]Wenqi Jiang, Marco Zeller, Roger Waleffe, Torsten Hoefler, Gustavo Alonso:
Chameleon: a Heterogeneous and Disaggregated Accelerator System for Retrieval-Augmented Language Models. CoRR abs/2310.09949 (2023)
[i126]Patrick Iff, Benigna Bruggmann, Maciej Besta, Luca Benini, Torsten Hoefler:
RapidChiplet: A Toolchain for Rapid Design Space Exploration of Chiplet Architectures. CoRR abs/2311.06081 (2023)
[i125]Wei Qiu, Marcin Copik
, Yun Wang, Alexandru Calotoiu, Torsten Hoefler:
User-guided Page Merging for Memory Deduplication in Serverless Systems. CoRR abs/2311.13588 (2023)
[i124]Maciej Besta, Afonso Claudino Catarino, Lukas Gianinazzi, Nils Blach, Piotr Nyczyk, Hubert Niewiadomski, Torsten Hoefler:
HOT: Higher-Order Dynamic Graph Representation Learning with Efficient Transformers. CoRR abs/2311.18526 (2023)
[i123]Eldar Kurtic, Torsten Hoefler, Dan Alistarh:
How to Prune Your Language Model: Recovering Accuracy on the "Sparsity May Cry" Benchmark. CoRR abs/2312.13547 (2023)- 2022
[j55]Torsten Hoefler, Ariel Hendel, Duncan Roweth:
The Convergence of Hyperscale Data Center and High-Performance Computing Networks. Computer 55(7): 29-37 (2022)
[j54]Torsten Hoefler:
Benchmarking Data Science: 12 Ways to Lie With Statistics and Performance on Parallel Computers. Computer 55(8): 49-56 (2022)
[j53]Marcin Copik
, Tobias Grosser
, Torsten Hoefler, Paolo Bientinesi, Benjamin Berkels
:
Work-Stealing Prefix Scan: Addressing Load Imbalance in Large-Scale Image Registration. IEEE Trans. Parallel Distributed Syst. 33(3): 523-535 (2022)
[j52]David Ittah
, Thomas Häner
, Vadym Kliuchnikov
, Torsten Hoefler:
QIRO: A Static Single Assignment-based Quantum Program Representation for Optimization. ACM Trans. Quantum Comput. 3(3): 14:1-14:32 (2022)
[c236]Konstantin Taranov, Benjamin Rothenberger, Daniele De Sensi, Adrian Perrig, Torsten Hoefler:
NeVerMore: Exploiting RDMA Mistakes in NVMe-oF Storage Applications. CCS 2022: 2765-2778
[c235]Andrea Cossettini
, Konstantin Taranov, Christian Vogt, Michele Magno
, Torsten Hoefler, Luca Benini:
A RDMA Interface for Ultra-Fast Ultrasound Data-Streaming over an Optical Link. DATE 2022: 80-83
[c234]Niels Gleinig, Torsten Hoefler:
Circuits for Measurement Based Quantum State Preparation. DATE 2022: 328-333
[c233]Andrea Biagioni, Paolo Cretaro, Ottorino Frezza, Francesca Lo Cicero, Alessandro Lonardo
, Michele Martinelli, Pier Stanislao Paolucci
, Elena Pastorelli, Francesco Simula, Matteo Turisini
, Piero Vicini
, Roberto Ammendola, Pascale Bernier-Bruna, Claire Chen, Said Derradji, Stéphane Guez, Pierre-Axel Lagadec, Gregoire Pichon, Etienne Walter, Gaetan De Gassowski, Matthieu Hautreaux, Stephane Mathieu, Gilles Moreau, Marc Pérache
, Hugo Taboada, Torsten Hoefler, Timo Schneider, Matteo Barnaba, Giuseppe Piero Brandino, Francesco De Giorgi, Matteo Poggi, Iakovos Mavroidis, Yannis Papaefstathiou, Nikolaos Tampouratzis
, Benjamin Kalisch, Ulrich Krackhardt, Mondrian Nuessle, Pantelis Xirouchakis, Vangelis Mageiropoulos, Michalis Gianioudis, Harisis Loukas, Aggelos Ioannou
, Nikos Kallimanis, Nikos Chrysos, Manolis Katevenis, Wolfgang Frings, Dominik Gottwald, Felime Guimaraes, Max Holicki, Volker Marx, Yannik Müller, Carsten Clauss
, Hugo Falter, Xu Huang, Jennifer Lopez Barillao, Thomas Moschny, Simon Pickartz, Francisco J. Alfaro, Jesús Escudero-Sahuquillo
, Pedro Javier García, Francisco J. Quiles, José L. Sánchez, Adrián Castelló
, Jose Duro, María Engracia Gómez, Enrique S. Quintana-Ortí, Julio Sahuquillo, Eugenio Stabile:
RED-SEA: Network Solution for Exascale Architectures. DSD 2022: 712-719
[c232]Shiyi Cao, Salvatore Di Girolamo, Torsten Hoefler:
Accelerating Data Serialization/Deserialization Protocols with In-Network Compute. ExaMPI@SC 2022: 22-30
[c231]Johannes de Fine Licht, Christopher A. Pattison, Alexandros Nikolaos Ziogas
, David Simmons-Duffin, Torsten Hoefler:
Fast Arbitrary Precision Floating Point on FPGA. FCCM 2022: 1-9
[c230]Carl-Johannes Johnsen
, Tiziano De Matteis
, Tal Ben-Nun, Johannes de Fine Licht, Torsten Hoefler:
Temporal Vectorization: A Compiler Approach to Automatic Multi-Pumping. ICCAD 2022: 85:1-85:9
[c229]Bryan A. Plummer, Nikoli Dryden, Julius Frost, Torsten Hoefler, Kate Saenko:
Neural Parameter Allocation Search. ICLR 2022
[c228]Larissa Schmid
, Marcin Copik
, Alexandru Calotoiu, Dominik Werle, Andreas Reiter, Michael Selzer
, Anne Koziolek, Torsten Hoefler:
Performance-detective: automatic deduction of cheap and accurate performance models. ICS 2022: 3:1-3:13
[c227]Alexandru Calotoiu, Tal Ben-Nun, Grzegorz Kwasniewski, Johannes de Fine Licht, Timo Schneider, Philipp Schaad
, Torsten Hoefler:
Lifting C semantics for dataflow optimization. ICS 2022: 17:1-17:13
[c226]Oliver Rausch, Tal Ben-Nun, Nikoli Dryden, Andrei Ivanov, Shigang Li, Torsten Hoefler:
A data-centric optimization framework for machine learning. ICS 2022: 36:1-36:13
[c225]Andrei Lascu
, Alastair F. Donaldson, Tobias Grosser
, Torsten Hoefler:
Metamorphic Fuzzing of C++ Libraries. ICST 2022: 35-46
[c224]Niels Gleinig, Maciej Besta, Torsten Hoefler:
I/O-Optimal Cache-Oblivious Sparse Matrix-Sparse Matrix Multiplication. IPDPS 2022: 36-46
[c223]András Strausz, Flavio Vella
, Salvatore Di Girolamo, Maciej Besta, Torsten Hoefler:
Asynchronous Distributed-Memory Triangle Counting and LCC with RMA Caching. IPDPS 2022: 291-301
[c222]Maciej Besta, Raphael Grob, Cesare Miglioli
, Nicola Bernold, Grzegorz Kwasniewski, Gabriel Gjini, Raghavendra Kanakagiri
, Saleh Ashkboos, Lukas Gianinazzi, Nikoli Dryden, Torsten Hoefler:
Motif Prediction with Graph Neural Networks. KDD 2022: 35-45
[c221]Maciej Besta, Patrick Iff, Florian Scheidl, Kazuki Osawa, Nikoli Dryden, Michal Podstawski, Tiancheng Chen, Torsten Hoefler:
Neural Graph Databases. LoG 2022: 31
[c220]Saleh Ashkboos, Langwen Huang, Nikoli Dryden, Tal Ben-Nun, Peter Dueben, Lukas Gianinazzi, Luca Kummer, Torsten Hoefler:
ENS-10: A Dataset For Post-Processing Ensemble Weather Forecasts. NeurIPS 2022
[c219]Nikoli Dryden, Torsten Hoefler:
Spatial Mixture-of-Experts. NeurIPS 2022
[c218]Shigang Li, Torsten Hoefler:
Near-optimal sparse allreduce for distributed deep learning. PPoPP 2022: 135-149
[c217]Salvatore Di Girolamo, Daniele De Sensi, Konstantin Taranov, Milos Malesevic, Maciej Besta, Timo Schneider, Severin Kistler, Torsten Hoefler:
Building Blocks for Network-Accelerated Distributed File Systems. SC 2022: 10:1-10:14
[c216]Torsten Hoefler, Tommaso Bonato
, Daniele De Sensi, Salvatore Di Girolamo, Shigang Li, Marco Heddes, Jon Belk, Deepak Goel, Miguel Castro, Steve Scott:
HammingMesh: A Network Topology for Large-Scale Deep Learning. SC 2022: 11:1-11:18
[c215]Kartik Lakhotia, Maciej Besta, Laura Monroe, Kelly Isham
, Patrick Iff, Torsten Hoefler, Fabrizio Petrini:
PolarFly: A Cost-Effective and Flexible Low-Diameter Topology. SC 2022: 12:1-12:15
[c214]Alexandros Nikolaos Ziogas
, Grzegorz Kwasniewski, Tal Ben-Nun, Timo Schneider, Torsten Hoefler:
Deinsum: Practically I/O Optimal Multi-Linear Algebra. SC 2022: 25:1-25:15
[c213]Shigang Li
, Kazuki Osawa, Torsten Hoefler:
Efficient Quantized Sparse Matrix Operations on Tensor Cores. SC 2022: 37:1-37:15
[c212]Maciej Besta, Cesare Miglioli
, Paolo Sylos Labini
, Jakub Tetek, Patrick Iff, Raghavendra Kanakagiri
, Saleh Ashkboos, Kacper Janda, Michal Podstawski, Grzegorz Kwasniewski, Niels Gleinig, Flavio Vella
, Onur Mutlu
, Torsten Hoefler:
ProbGraph: High-Performance and High-Accuracy Graph Mining with Probabilistic Set Representations. SC 2022: 43:1-43:17
[c211]Philipp Schaad
, Tal Ben-Nun, Torsten Hoefler:
Boosting Performance Optimization with Interactive Data Movement Visualization. SC 2022: 64:1-64:16
[c210]Tal Ben-Nun, Linus Groner, Florian Deconinck
, Tobias Wicky, Eddie Davis, Johann Dahm, Oliver Elbert
, Rhea George, Jeremy McGibbon, Lukas Trümper, Elynn Wu, Oliver Fuhrer, Thomas C. Schulthess
, Torsten Hoefler:
Productive Performance Engineering for Weather and Climate Modeling with Python. SC 2022: 73:1-73:14
[c209]Konstantin Taranov, Steve Byan, Virendra J. Marathe, Torsten Hoefler:
KafkaDirect: Zero-copy Data Access for Apache Kafka over RDMA Networks. SIGMOD Conference 2022: 2191-2204
[c208]Niels Gleinig, Torsten Hoefler:
The Red-Blue Pebble Game on Trees and DAGs with Large Input. SIROCCO 2022: 135-153
[i122]Shigang Li, Torsten Hoefler:
Near-Optimal Sparse Allreduce for Distributed Deep Learning. CoRR abs/2201.07598 (2022)
[i121]Konstantin Taranov, Benjamin Rothenberger, Daniele De Sensi, Adrian Perrig, Torsten Hoefler:
NeVerMore: Exploiting RDMA Mistakes in NVMe-oF Storage Applications. CoRR abs/2202.08080 (2022)
[i120]András Strausz, Flavio Vella, Salvatore Di Girolamo, Maciej Besta, Torsten Hoefler:
Asynchronous Distributed-Memory Triangle Counting and LCC with RMA Caching. CoRR abs/2202.13976 (2022)
[i119]Marcin Copik
, Alexandru Calotoiu, Konstantin Taranov, Torsten Hoefler:
FaasKeeper: a Blueprint for Serverless Services. CoRR abs/2203.14859 (2022)
[i118]Johannes de Fine Licht, Christopher A. Pattison, Alexandros Nikolaos Ziogas, David Simmons-Duffin, Torsten Hoefler:
Fast Arbitrary Precision Floating Point on FPGA. CoRR abs/2204.06256 (2022)
[i117]Tal Ben-Nun, Linus Groner, Florian Deconinck, Tobias Wicky, Eddie Davis, Johann Dahm, Oliver Elbert
, Rhea George, Jeremy McGibbon, Lukas Trümper, Elynn Wu, Oliver Fuhrer, Thomas C. Schulthess, Torsten Hoefler:
Productive Performance Engineering for Weather and Climate Modeling with Python. CoRR abs/2205.04148 (2022)
[i116]Lukas Gianinazzi, Tal Ben-Nun, Saleh Ashkboos, Yves Baumann, Piotr Luczynski, Torsten Hoefler:
The spatial computer: A model for energy-efficient parallel computation. CoRR abs/2205.04934 (2022)
[i115]Maciej Besta, Torsten Hoefler:
Parallel and Distributed Graph Neural Networks: An In-Depth Concurrency Analysis. CoRR abs/2205.09702 (2022)
[i114]Alexandros Nikolaos Ziogas, Grzegorz Kwasniewski, Tal Ben-Nun, Timo Schneider, Torsten Hoefler:
Deinsum: Practically I/O Optimal Multilinear Algebra. CoRR abs/2206.08301 (2022)
[i113]Salvatore Di Girolamo, Daniele De Sensi, Konstantin Taranov, Milos Malesevic, Maciej Besta, Timo Schneider, Severin Kistler, Torsten Hoefler:
Building Blocks for Network-Accelerated Distributed File Systems. CoRR abs/2206.10007 (2022)
[i112]Saleh Ashkboos, Langwen Huang, Nikoli Dryden, Tal Ben-Nun, Peter Dueben, Lukas Gianinazzi, Luca Kummer, Torsten Hoefler:
ENS-10: A Dataset For Post-Processing Ensemble Weather Forecast. CoRR abs/2206.14786 (2022)
[i111]Philipp Schaad
, Tal Ben-Nun, Torsten Hoefler:
Boosting Performance Optimization with Interactive Data Movement Visualization. CoRR abs/2207.07433 (2022)
[i110]Kartik Lakhotia, Maciej Besta, Laura Monroe, Kelly Isham, Patrick Iff, Torsten Hoefler, Fabrizio Petrini:
PolarFly: A Cost-Effective and Flexible Low-Diameter Topology. CoRR abs/2208.01695 (2022)
[i109]Maciej Besta, Cesare Miglioli, Paolo Sylos Labini
, Jakub Tetek, Patrick Iff, Raghavendra Kanakagiri
, Saleh Ashkboos, Kacper Janda, Michal Podstawski
, Grzegorz Kwasniewski, Niels Gleinig, Flavio Vella, Onur Mutlu
, Torsten Hoefler:
ProbGraph: High-Performance and High-Accuracy Graph Mining with Probabilistic Set Representations. CoRR abs/2208.11469 (2022)
[i108]Torsten Hoefler, Tommaso Bonato, Daniele De Sensi, Salvatore Di Girolamo, Shigang Li, Marco Heddes, Jon Belk, Deepak Goel, Miguel Castro, Steve Scott:
HammingMesh: A Network Topology for Large-Scale Deep Learning. CoRR abs/2209.01346 (2022)
[i107]Andrei Ivanov, Benjamin Rothenberger, Arnaud Dethise, Marco Canini
, Torsten Hoefler, Adrian Perrig
:
SAGE: Software-based Attestation for GPU Execution. CoRR abs/2209.03125 (2022)
[i106]Shigang Li, Kazuki Osawa, Torsten Hoefler:
Efficient Quantized Sparse Matrix Operations on Tensor Cores. CoRR abs/2209.06979 (2022)
[i105]Maciej Besta, Patrick Iff, Florian Scheidl, Kazuki Osawa, Nikoli Dryden, Michal Podstawski
, Tiancheng Chen, Torsten Hoefler:
Neural Graph Databases. CoRR abs/2209.09732 (2022)
[i104]Carl-Johannes Johnsen, Tiziano De Matteis, Tal Ben-Nun, Johannes de Fine Licht, Torsten Hoefler:
Temporal Vectorization: A Compiler Approach to Automatic Multi-Pumping. CoRR abs/2210.04598 (2022)
[i103]Langwen Huang, Torsten Hoefler:
Compressing multidimensional weather and climate data into neural networks. CoRR abs/2210.12538 (2022)
[i102]Daniele De Sensi, Tiziano De Matteis, Konstantin Taranov, Salvatore Di Girolamo, Tobias Rahn, Torsten Hoefler:
Noise in the Clouds: Influence of Network Performance Variability on Application Scalability. CoRR abs/2210.15315 (2022)
[i101]Elias Frantar, Saleh Ashkboos, Torsten Hoefler, Dan Alistarh:
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers. CoRR abs/2210.17323 (2022)
[i100]Michael E. Beverland, Prakash Murali, Matthias Troyer, Krysta M. Svore, Torsten Hoefler, Vadym Kliuchnikov, Guang Hao Low, Mathias Soeken, Aarthi Sundaram, Alexander Vaschillo:
Assessing requirements to scale to practical quantum advantage. CoRR abs/2211.07629 (2022)
[i99]Nikoli Dryden, Torsten Hoefler:
Spatial Mixture-of-Experts. CoRR abs/2211.13491 (2022)
[i98]Patrick Iff, Maciej Besta, Matheus A. Cavalcante
, Tim Fischer, Luca Benini, Torsten Hoefler:
Sparse Hamming Graph: A Customizable Network-on-Chip Topology. CoRR abs/2211.13980 (2022)
[i97]Patrick Iff, Maciej Besta, Matheus A. Cavalcante
, Tim Fischer, Luca Benini, Torsten Hoefler:
HexaMesh: Scaling to Hundreds of Chiplets with an Optimized Chiplet Arrangement. CoRR abs/2211.13989 (2022)
[i96]Kazuki Osawa, Shigang Li, Torsten Hoefler:
PipeFisher: Efficient Training of Large Language Models Using Pipelining and Fisher Information Matrices. CoRR abs/2211.14133 (2022)
[i95]Konstantin Taranov, Fabian Fischer, Torsten Hoefler:
Efficient RDMA Communication Protocols. CoRR abs/2212.09134 (2022)
[i94]Johannes de Fine Licht, Tiziano De Matteis, Tal Ben-Nun, Andreas Kuster, Oliver Rausch, Manuel Burger
, Carl-Johannes Johnsen
, Torsten Hoefler:
Python FPGA Programming with Data-Centric Multi-Level Design. CoRR abs/2212.13768 (2022)- 2021
[j51]Torsten Hoefler, Dan Alistarh, Tal Ben-Nun, Nikoli Dryden, Alexandra Peste:
Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks. J. Mach. Learn. Res. 22: 241:1-241:124 (2021)
[j50]Peter Bauer
, Peter D. Düben, Torsten Hoefler, Tiago Quintino
, Thomas C. Schulthess
, Nils P. Wedi:
The digital revolution of Earth-system science. Nat. Comput. Sci. 1(2): 104-113 (2021)
[j49]Arjun Pitchanathan, Christian Ulmann, Michel Weber
, Torsten Hoefler, Tobias Grosser
:
FPL: fast Presburger arithmetic through transprecision. Proc. ACM Program. Lang. 5(OOPSLA): 1-26 (2021)
[j48]Daniele De Sensi
, Tiziano De Matteis
, Konstantin Taranov
, Salvatore Di Girolamo
, Tobias Rahn
, Torsten Hoefler
:
Noise in the Clouds: Influence of Network Performance Variability on Application Scalability. Proc. ACM Meas. Anal. Comput. Syst. 6(3): 49:1-49:27 (2021)
[j47]Maciej Besta, Zur Vonarburg-Shmaria, Yannick Schaffner, Leonardo Schwarz, Grzegorz Kwasniewski, Lukas Gianinazzi
, Jakub Beránek, Kacper Janda, Tobias Holenstein, Sebastian Leisinger, Peter Tatkowski, Esref Özdemir, Adrian Balla, Marcin Copik
, Philipp Lindenberger, Marek Konieczny
, Onur Mutlu
, Torsten Hoefler:
GraphMineSuite: Enabling High-Performance and Programmable Graph Mining Algorithms with Set Algebra. Proc. VLDB Endow. 14(11): 1922-1936 (2021)
[j46]Edgar Solomonik, James Demmel, Torsten Hoefler:
Communication Lower Bounds of Bilinear Algorithms for Symmetric Tensor Contractions. SIAM J. Sci. Comput. 43(5): A3328-A3356 (2021)
[j45]Tobias Gysi, Christoph Müller, Oleksandr Zinenko
, Stephan Herhut, Eddie Davis, Tobias Wicky, Oliver Fuhrer, Torsten Hoefler, Tobias Grosser
:
Domain-Specific Multi-Level IR Rewriting for GPU: The Open Earth Compiler for GPU-accelerated Climate Simulation. ACM Trans. Archit. Code Optim. 18(4): 51:1-51:23 (2021)
[j44]Fabian Schuiki
, Florian Zaruba
, Torsten Hoefler, Luca Benini
:
Stream Semantic Registers: A Lightweight RISC-V ISA Extension Achieving Full Compute Utilization in Single-Issue Cores. IEEE Trans. Computers 70(2): 212-227 (2021)
[j43]Florian Zaruba
, Fabian Schuiki
, Torsten Hoefler, Luca Benini
:
Snitch: A Tiny Pseudo Dual-Issue Processor for Area and Energy Efficient Execution of Floating-Point Intensive Workloads. IEEE Trans. Computers 70(11): 1845-1860 (2021)
[j42]Maciej Besta
, Jens Domke
, Marcel Schneider, Marek Konieczny
, Salvatore Di Girolamo, Timo Schneider, Ankit Singla, Torsten Hoefler:
High-Performance Routing With Multipathing and Path Diversity in Ethernet and HPC Networks. IEEE Trans. Parallel Distributed Syst. 32(4): 943-959 (2021)
[j41]Johannes de Fine Licht
, Maciej Besta
, Simon Meierhans
, Torsten Hoefler
:
Transformations of High-Level Synthesis Codes for High-Performance Computing. IEEE Trans. Parallel Distributed Syst. 32(5): 1014-1029 (2021)
[j40]Shigang Li
, Tal Ben-Nun
, Giorgi Nadiradze, Salvatore Di Girolamo, Nikoli Dryden, Dan Alistarh, Torsten Hoefler:
Breaking (Global) Barriers in Parallel Stochastic Optimization With Wait-Avoiding Group Averaging. IEEE Trans. Parallel Distributed Syst. 32(7): 1725-1739 (2021)
[c207]Dan Graur, Rodrigo Bruno
, Joschka Bischoff, Marcel Rieser, Wolfgang Scherr, Torsten Hoefler, Gustavo Alonso:
Hermes: Enabling efficient large-scale simulation in MATSim. ANT/EDI40 2021: 635-641
[c206]Johannes de Fine Licht
, Andreas Kuster, Tiziano De Matteis
, Tal Ben-Nun, Dominic Hofer
, Torsten Hoefler:
StencilFlow: Mapping Large Stencil Programs to Distributed Spatial Computing Systems. CGO 2021: 315-326
[c205]Niels Gleinig, Torsten Hoefler:
An Efficient Algorithm for Sparse Quantum State Preparation. DAC 2021: 433-438
[c204]Paul Scheffler, Florian Zaruba, Fabian Schuiki, Torsten Hoefler, Luca Benini:
Indirection Stream Semantic Register Architecture for Efficient Sparse-Dense Linear Algebra. DATE 2021: 1787-1792
[c203]Chris Cummins, Zacharias V. Fisches, Tal Ben-Nun, Torsten Hoefler, Michael F. P. O'Boyle, Hugh Leather:
ProGraML: A Graph-based Program Representation for Data Flow Analysis and Compiler Optimizations. ICML 2021: 2244-2253
[c202]Alexandros Nikolaos Ziogas
, Tal Ben-Nun, Timo Schneider, Torsten Hoefler:
NPBench: a benchmarking suite for high-performance NumPy. ICS 2021: 63-74
[c201]Marcus Ritter
, Alexander Geiß
, Johannes Wehrstein, Alexandru Calotoiu, Thorsten Reimann
, Torsten Hoefler, Felix Wolf:
Noise-Resilient Empirical Performance Modeling with Deep Neural Networks. IPDPS 2021: 23-34
[c200]Salvatore Di Girolamo, Andreas Kurth, Alexandru Calotoiu, Thomas Benz, Timo Schneider, Jakub Beránek
, Luca Benini, Torsten Hoefler:
A RISC-V in-network accelerator for flexible high-performance low-power packet processing. ISCA 2021: 958-971
[c199]Maciej Besta, Raghavendra Kanakagiri
, Grzegorz Kwasniewski, Rachata Ausavarungnirun, Jakub Beránek
, Konstantinos Kanellopoulos, Kacper Janda, Zur Vonarburg-Shmaria, Lukas Gianinazzi, Ioana Stefan, Juan Gómez-Luna, Jakub Golinowski, Marcin Copik
, Lukas Kapp-Schwoerer
, Salvatore Di Girolamo, Nils Blach, Marek Konieczny
, Onur Mutlu
, Torsten Hoefler:
SISA: Set-Centric Instruction Set Architecture for Graph Mining on Processing-in-Memory Systems. MICRO 2021: 282-297
[c198]Marcin Copik
, Grzegorz Kwasniewski, Maciej Besta, Michal Podstawski, Torsten Hoefler:
SeBS: a serverless benchmark suite for function-as-a-service computing. Middleware 2021: 64-78
[c197]Andrei Ivanov, Nikoli Dryden, Tal Ben-Nun, Shigang Li, Torsten Hoefler:
Data Movement Is All You Need: A Case Study on Optimizing Transformers. MLSys 2021
[c196]Marcin Copik
, Alexandru Calotoiu, Tobias Grosser
, Nicolas Wicki, Felix Wolf, Torsten Hoefler:
Extracting clean performance models from tainted programs. PPoPP 2021: 403-417
[c195]Grzegorz Kwasniewski, Tal Ben-Nun, Alexandros Nikolaos Ziogas
, Timo Schneider, Maciej Besta, Torsten Hoefler:
On the parallel I/O optimality of linear algebra kernels: near-optimal LU factorization. PPoPP 2021: 463-464
[c194]Thomas Häner, Damian S. Steiger, Torsten Hoefler, Matthias Troyer:
Distributed quantum computing with QMPI. SC 2021: 16
[c193]Shigang Li, Torsten Hoefler:
Chimera: efficiently training large-scale neural networks with bidirectional pipelines. SC 2021: 27
[c192]Daniele De Sensi, Salvatore Di Girolamo, Saleh Ashkboos, Shigang Li, Torsten Hoefler:
Flare: flexible in-network allreduce. SC 2021: 35
[c191]Grzegorz Kwasniewski, Marko Kabic
, Tal Ben-Nun, Alexandros Nikolaos Ziogas
, Jens Eirik Saethre
, André Gaillard, Timo Schneider, Maciej Besta, Anton Kozhevnikov, Joost VandeVondele, Torsten Hoefler:
On the parallel I/O optimality of linear algebra kernels: near-optimal matrix factorizations. SC 2021: 70
[c190]Nikoli Dryden, Roman Böhringer, Tal Ben-Nun, Torsten Hoefler:
Clairvoyant prefetching for distributed machine learning I/O. SC 2021: 92
[c189]Alexandros Nikolaos Ziogas
, Timo Schneider, Tal Ben-Nun, Alexandru Calotoiu, Tiziano De Matteis
, Johannes de Fine Licht, Luca Lavarini, Torsten Hoefler:
Productivity, portability, performance: data-centric Python. SC 2021: 95
[c188]Konstantin Taranov, Salvatore Di Girolamo, Torsten Hoefler:
CoRM: Compactable Remote Memory over RDMA. SIGMOD Conference 2021: 1811-1824
[c187]Lukas Gianinazzi
, Maciej Besta, Yannick Schaffner, Torsten Hoefler:
Parallel Algorithms for Finding Large Cliques in Sparse Graphs. SPAA 2021: 243-253
[c186]Grzegorz Kwasniewski, Tal Ben-Nun, Lukas Gianinazzi
, Alexandru Calotoiu, Timo Schneider, Alexandros Nikolaos Ziogas
, Maciej Besta, Torsten Hoefler:
Pebbles, Graphs, and a Pinch of Combinatorics: Towards Tight I/O Lower Bounds for Statically Analyzable Programs. SPAA 2021: 328-339
[c185]Konstantin Taranov, Rodrigo Bruno, Gustavo Alonso, Torsten Hoefler:
Naos: Serialization-free RDMA networking in Java. USENIX ATC 2021: 1-14
[c184]Maksym Planeta, Jan Bierbaum, Leo Sahaya Daphne Antony, Torsten Hoefler, Hermann Härtig:
MigrOS: Transparent Live-Migration Support for Containerised RDMA Applications. USENIX ATC 2021: 47-63
[c183]Benjamin Rothenberger, Konstantin Taranov, Adrian Perrig, Torsten Hoefler:
ReDMArk: Bypassing RDMA Security Mechanisms. USENIX Security Symposium 2021: 4277-4292
[i93]Roman Böhringer, Nikoli Dryden, Tal Ben-Nun, Torsten Hoefler:
Clairvoyant Prefetching for Distributed Machine Learning I/O. CoRR abs/2101.08734 (2021)
[i92]David Ittah, Thomas Häner, Vadym Kliuchnikov, Torsten Hoefler:
Enabling Dataflow Optimization for Quantum Programs. CoRR abs/2101.11030 (2021)
[i91]Torsten Hoefler, Dan Alistarh, Tal Ben-Nun, Nikoli Dryden, Alexandra Peste:
Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks. CoRR abs/2102.00554 (2021)
[i90]Maciej Besta, Zur Vonarburg-Shmaria, Yannick Schaffner, Leonardo Schwarz, Grzegorz Kwasniewski, Lukas Gianinazzi, Jakub Beránek, Kacper Janda, Tobias Holenstein, Sebastian Leisinger, Peter Tatkowski, Esref Özdemir, Adrian Balla, Marcin Copik
, Philipp Lindenberger, Pavel Kalvoda, Marek Konieczny, Onur Mutlu
, Torsten Hoefler:
GraphMineSuite: Enabling High-Performance and Programmable Graph Mining Algorithms with Set Algebra. CoRR abs/2103.03653 (2021)
[i89]Maciej Besta, Raghavendra Kanakagiri, Grzegorz Kwasniewski, Rachata Ausavarungnirun, Jakub Beránek, Konstantinos Kanellopoulos, Kacper Janda, Zur Vonarburg-Shmaria, Lukas Gianinazzi, Ioana Stefan, Juan Gómez-Luna, Marcin Copik
, Lukas Kapp-Schwoerer, Salvatore Di Girolamo, Marek Konieczny, Onur Mutlu
, Torsten Hoefler:
SISA: Set-Centric Instruction Set Architecture for Graph Mining on Processing-in-Memory Systems. CoRR abs/2104.07582 (2021)
[i88]Thomas Häner, Damian S. Steiger, Torsten Hoefler, Matthias Troyer:
Distributed Quantum Computing with QMPI. CoRR abs/2105.01109 (2021)
[i87]Grzegorz Kwasniewski, Tal Ben-Nun, Lukas Gianinazzi, Alexandru Calotoiu, Timo Schneider, Alexandros Nikolaos Ziogas, Maciej Besta, Torsten Hoefler:
Pebbles, Graphs, and a Pinch of Combinatorics: Towards Tight I/O Lower Bounds for Statically Analyzable Programs. CoRR abs/2105.07203 (2021)
[i86]Maciej Besta, Marcel Schneider, Salvatore Di Girolamo, Ankit Singla, Torsten Hoefler:
Towards Million-Server Network Simulations on Just a Laptop. CoRR abs/2105.12663 (2021)
[i85]Maciej Besta, Raphael Grob, Cesare Miglioli, Nicola Bernold, Grzegorz Kwasniewski, Gabriel Gjini, Raghavendra Kanakagiri, Saleh Ashkboos, Lukas Gianinazzi, Nikoli Dryden, Torsten Hoefler:
Motif Prediction with Graph Neural Networks. CoRR abs/2106.00761 (2021)
[i84]Lukas Gianinazzi, Maximilian Fries, Nikoli Dryden, Tal Ben-Nun, Maciej Besta, Torsten Hoefler:
Learning Combinatorial Node Labeling Algorithms. CoRR abs/2106.03594 (2021)
[i83]Marcin Copik
, Konstantin Taranov, Alexandru Calotoiu, Torsten Hoefler:
RFaaS: RDMA-Enabled FaaS Platform for Serverless High-Performance Computing. CoRR abs/2106.13859 (2021)
[i82]Daniele De Sensi, Salvatore Di Girolamo, Saleh Ashkboos, Shigang Li, Torsten Hoefler:
Flare: Flexible In-Network Allreduce. CoRR abs/2106.15565 (2021)
[i81]Alexandros Nikolaos Ziogas, Timo Schneider, Tal Ben-Nun, Alexandru Calotoiu, Tiziano De Matteis, Johannes de Fine Licht
, Luca Lavarini, Torsten Hoefler:
Productivity, Portability, Performance: Data-Centric Python. CoRR abs/2107.00555 (2021)
[i80]Shigang Li, Torsten Höfler:
Chimera: Efficiently Training Large-Scale Neural Networks with Bidirectional Pipelines. CoRR abs/2107.06925 (2021)
[i79]Grzegorz Kwasniewski, Marko Kabic, Tal Ben-Nun, Alexandros Nikolaos Ziogas, Jens Eirik Saethre, André Gaillard, Timo Schneider, Maciej Besta, Anton Kozhevnikov, Joost VandeVondele, Torsten Hoefler:
On the Parallel I/O Optimality of Linear Algebra Kernels: Near-Optimal Matrix Factorizations. CoRR abs/2108.09337 (2021)
[i78]Lukas Gianinazzi, Maciej Besta, Yannick Schaffner, Torsten Hoefler:
Parallel Algorithms for Finding Large Cliques in Sparse Graphs. CoRR abs/2109.09663 (2021)
[i77]Oliver Rausch, Tal Ben-Nun, Nikoli Dryden, Andrei Ivanov, Shigang Li, Torsten Hoefler:
A Data-Centric Optimization Framework for Machine Learning. CoRR abs/2110.10802 (2021)
[i76]Alexandru Calotoiu, Tal Ben-Nun, Grzegorz Kwasniewski, Johannes de Fine Licht, Timo Schneider, Philipp Schaad, Torsten Hoefler:
Lifting C Semantics for Dataflow Optimization. CoRR abs/2112.11879 (2021)- 2020
[j39]Thomas Häner, Torsten Hoefler, Matthias Troyer:
Assertion-based optimization of Quantum programs. Proc. ACM Program. Lang. 4(OOPSLA): 133:1-133:20 (2020)
[j38]Tobias Grosser
, Theodoros Theodoridis, Maximilian Falkenstein, Arjun Pitchanathan, Michael Kruse
, Manuel Rigger, Zhendong Su
, Torsten Hoefler:
Fast linear programming through transprecision computing on small and sparse data. Proc. ACM Program. Lang. 4(OOPSLA): 195:1-195:28 (2020)
[j37]Jesper Larsson Träff, Torsten Hoefler:
Special issue: Selected papers from EuroMPI 2019. Parallel Comput. 99: 102695 (2020)
[j36]Carlos Osuna, Tobias Wicky, Fabian Thuering, Torsten Hoefler, Oliver Fuhrer:
Dawn: a High-level Domain-Specific Language Compiler Toolchain for Weather and Climate Applications. Supercomput. Front. Innov. 7(2): 79-97 (2020)
[j35]Asif Ali Khan
, Hauke Mewes, Tobias Grosser
, Torsten Hoefler, Jerónimo Castrillón
:
Polyhedral Compilation for Racetrack Memories. IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 39(11): 3968-3980 (2020)
[j34]Maciej Besta, Marc Fischer, Tal Ben-Nun, Dimitri Stanojevic, Johannes de Fine Licht, Torsten Hoefler:
Substream-Centric Maximum Matchings on FPGA. ACM Trans. Reconfigurable Technol. Syst. 13(2): 8:1-8:33 (2020)
[c182]Elad Hoffer, Tal Ben-Nun, Itay Hubara, Niv Giladi, Torsten Hoefler, Daniel Soudry:
Augment Your Batch: Improving Generalization Through Instance Repetition. CVPR 2020: 8126-8135
[c181]Andreas Kurth
, Samuel Riedel
, Florian Zaruba, Torsten Hoefler, Luca Benini:
ATUNs: Modular and Scalable Support for Atomic Operations in a Shared Memory Multiprocessor. DAC 2020: 1-6
[c180]Johannes de Fine Licht
, Grzegorz Kwasniewski, Torsten Hoefler:
Flexible Communication Avoiding Matrix Multiplication on FPGA with High-Level Synthesis. FPGA 2020: 244-254
[c179]Marcus Ritter
, Alexandru Calotoiu, Sebastian Rinke, Thorsten Reimann
, Torsten Hoefler, Felix Wolf:
Learning Cost-Effective Sampling Strategies for Empirical Performance Modeling. IPDPS 2020: 884-895
[c178]Maciej Besta, Raghavendra Kanakagiri
, Harun Mustafa
, Mikhail Karasikov, Gunnar Rätsch, Torsten Hoefler, Edgar Solomonik:
Communication-Efficient Jaccard similarity for High-Performance Distributed Genome Comparisons. IPDPS 2020: 1122-1132
[c177]Shigang Li, Tal Ben-Nun, Salvatore Di Girolamo, Dan Alistarh, Torsten Hoefler:
Taming unbalanced training workloads in deep learning with partial collective operations. PPoPP 2020: 45-61
[c176]Yuyang Jin, Haojie Wang, Xiongchao Tang, Torsten Hoefler, Xu Liu, Jidong Zhai:
Identifying scalability bottlenecks for large-scale parallel programs with graph analysis. PPoPP 2020: 409-410
[c175]Alexandr Nigay
, Lukas Mosimann, Timo Schneider, Torsten Hoefler:
Communication and Timing Issues with MPI Virtualization. EuroMPI 2020: 11-20
[c174]Maciej Besta, Marcel Schneider
, Marek Konieczny
, Karolina Cynk, Erik Henriksson, Salvatore Di Girolamo, Ankit Singla, Torsten Hoefler:
FatPaths: routing in supercomputers and data centers when shortest paths fall short. SC 2020: 27
[c173]Yuyang Jin, Haojie Wang, Teng Yu, Xiongchao Tang, Torsten Hoefler, Xu Liu, Jidong Zhai:
ScalAna: automating scaling loss detection with graph analysis. SC 2020: 28
[c172]Daniele De Sensi, Salvatore Di Girolamo, Kim H. McMahon, Duncan Roweth, Torsten Hoefler:
An in-depth analysis of the slingshot interconnect. SC 2020: 35
[c171]Tiziano De Matteis
, Johannes de Fine Licht
, Torsten Hoefler:
fBLAS: streaming linear algebra on FPGA. SC 2020: 59
[c170]Alexandru Calotoiu, Markus Geisenhofer, Florian Kummer, Marcus Ritter, Jens Weber, Torsten Hoefler, Martin Oberlack, Felix Wolf:
Empirical Modeling of Spatially Diverging Performance. HUST/ProTools@SC 2020: 71-80
[c169]Maciej Besta, Armon Carigiet, Kacper Janda, Zur Vonarburg-Shmaria, Lukas Gianinazzi, Torsten Hoefler:
High-performance parallel graph coloring with strong guarantees on work, depth, and quality. SC 2020: 99
[c168]Lukas Gianinazzi
, Torsten Hoefler:
Parallel Planar Subgraph Isomorphism and Vertex Connectivity. SPAA 2020: 269-280
[c167]Konstantin Taranov, Benjamin Rothenberger, Adrian Perrig, Torsten Hoefler:
sRDMA - Efficient NIC-based Authentication and Encryption for Remote Direct Memory Access. USENIX ATC 2020: 691-704
[p2]Alexandru Calotoiu, Marcin Copik
, Torsten Hoefler, Marcus Ritter
, Sergei Shudler, Felix Wolf:
ExtraPeak: Advanced Automatic Performance Modeling for HPC Applications. Software for Exascale Computing 2020: 453-482
[i75]Tobias Gysi, Tobias Grosser
, Laurin Brandner, Torsten Hoefler:
A Fast Analytical Model of Fully Associative Caches. CoRR abs/2001.01653 (2020)
[i74]Robert Gerstenberger, Maciej Besta, Torsten Hoefler:
Enabling Highly-Scalable Remote Memory Access Programming with MPI-3 One Sided. CoRR abs/2001.07747 (2020)
[i73]Florian Zaruba, Fabian Schuiki, Torsten Hoefler, Luca Benini:
Snitch: A 10 kGE Pseudo Dual-Issue Processor for Area and Energy Efficient Execution of Floating-Point Intensive Workloads. CoRR abs/2002.10143 (2020)
[i72]Chris Cummins, Zacharias V. Fisches, Tal Ben-Nun, Torsten Hoefler, Hugh Leather:
ProGraML: Graph-based Deep Learning for Program Optimization and Analysis. CoRR abs/2003.10536 (2020)
[i71]Shigang Li, Tal Ben-Nun, Dan Alistarh, Salvatore Di Girolamo, Nikoli Dryden, Torsten Hoefler:
Breaking (Global) Barriers in Parallel Stochastic Optimization with Wait-Avoiding Group Averaging. CoRR abs/2005.00124 (2020)
[i70]Peter Grönquist
, Chengyuan Yao, Tal Ben-Nun, Nikoli Dryden, Peter Dueben, Shigang Li, Torsten Hoefler:
Deep Learning for Post-Processing Ensemble Weather Forecasts. CoRR abs/2005.08748 (2020)
[i69]Tobias Gysi, Christoph Müller, Oleksandr Zinenko
, Stephan Herhut, Eddie Davis, Tobias Wicky, Oliver Fuhrer, Torsten Hoefler, Tobias Grosser
:
Domain-Specific Multi-Level IR Rewriting for GPU. CoRR abs/2005.13014 (2020)
[i68]Bryan A. Plummer, Nikoli Dryden, Julius Frost, Torsten Hoefler, Kate Saenko:
Shapeshifter Networks: Cross-layer Parameter Sharing for Scalable and Effective Deep Learning. CoRR abs/2006.10598 (2020)
[i67]Andrei Ivanov, Nikoli Dryden, Tal Ben-Nun, Shigang Li, Torsten Hoefler:
Data Movement Is All You Need: A Case Study on Optimizing Transformers. CoRR abs/2007.00072 (2020)
[i66]Lukas Gianinazzi, Torsten Hoefler:
Parallel Planar Subgraph Isomorphism and Vertex Connectivity. CoRR abs/2007.01199 (2020)
[i65]Maciej Besta, Jens Domke, Marcel Schneider, Marek Konieczny, Salvatore Di Girolamo, Timo Schneider, Ankit Singla, Torsten Hoefler:
High-Performance Routing with Multipathing and Path Diversity in Supercomputers and Data Centers. CoRR abs/2007.03776 (2020)
[i64]Daniele De Sensi, Salvatore Di Girolamo, Kim H. McMahon, Duncan Roweth, Torsten Hoefler:
An In-Depth Analysis of the Slingshot Interconnect. CoRR abs/2008.08886 (2020)
[i63]Maciej Besta, Armon Carigiet, Zur Vonarburg-Shmaria, Kacper Janda, Lukas Gianinazzi, Torsten Hoefler:
High-Performance Parallel Graph Coloring with Strong Guarantees on Work, Depth, and Quality. CoRR abs/2008.11321 (2020)
[i62]Yuyang Jin, Haojie Wang, Teng Yu, Xiongchao Tang, Torsten Hoefler, Xu Liu, Jidong Zhai:
ScalAna: Automating Scaling Loss Detection with Graph Analysis. CoRR abs/2009.01692 (2020)
[i61]Maksym Planeta, Jan Bierbaum, Leo Sahaya Daphne Antony, Torsten Hoefler, Hermann Härtig:
TardiS: Migrating Containers with RDMA Networks. CoRR abs/2009.06988 (2020)
[i60]Salvatore Di Girolamo, Andreas Kurth
, Alexandru Calotoiu, Thomas Benz, Timo Schneider, Jakub Beránek, Luca Benini, Torsten Hoefler:
PsPIN: A high-performance low-power architecture for flexible in-network compute. CoRR abs/2010.03536 (2020)
[i59]Grzegorz Kwasniewski, Tal Ben-Nun, Alexandros Nikolaos Ziogas, Timo Schneider, Maciej Besta, Torsten Hoefler:
On the Parallel I/O Optimality of Linear Algebra Kernels: Near-Optimal LU Factorization. CoRR abs/2010.05975 (2020)
[i58]Maciej Besta, Torsten Hoefler:
Fault Tolerance for Remote Memory Access Programming Models. CoRR abs/2010.09025 (2020)
[i57]Maciej Besta, Torsten Hoefler:
Accelerating Irregular Computations with Hardware Transactional Memory and Active Messages. CoRR abs/2010.09135 (2020)
[i56]Hermann Schweizer, Maciej Besta, Torsten Hoefler:
Evaluating the Cost of Atomic Operations on Modern Architectures. CoRR abs/2010.09852 (2020)
[i55]Patrick Schmid, Maciej Besta, Torsten Hoefler:
High-Performance Distributed RMA Locks. CoRR abs/2010.09854 (2020)
[i54]Maciej Besta, Florian Marending, Edgar Solomonik, Torsten Hoefler:
SlimSell: A Vectorizable Graph Representation for Breadth-First Search. CoRR abs/2010.09913 (2020)
[i53]Maciej Besta, Syed Minhaj Hassan, Sudhakar Yalamanchili, Rachata Ausavarungnirun, Onur Mutlu, Torsten Hoefler:
Slim NoC: A Low-Diameter On-Chip Network Topology for High Energy Efficiency and Scalability. CoRR abs/2010.10683 (2020)
[i52]Marcin Copik, Tobias Grosser, Torsten Hoefler, Paolo Bientinesi, Benjamin Berkels:
Work-stealing prefix scan: Addressing load imbalance in large-scale image registration. CoRR abs/2010.12478 (2020)
[i51]Maciej Besta, Marc Fischer, Tal Ben-Nun, Dimitri Stanojevic, Johannes de Fine Licht, Torsten Hoefler:
Substream-Centric Maximum Matchings on FPGA. CoRR abs/2010.14684 (2020)
[i50]Johannes de Fine Licht, Andreas Kuster, Tiziano De Matteis, Tal Ben-Nun, Dominic Hofer, Torsten Hoefler:
StencilFlow: Mapping Large Stencil Programs to Distributed Spatial Computing Systems. CoRR abs/2010.15218 (2020)
[i49]Maciej Besta, Dimitri Stanojevic, Tijana Zivic, Jagpreet Singh, Maurice Hoerold, Torsten Hoefler:
Log(Graph): A Near-Optimal High-Performance Graph Representation. CoRR abs/2010.15879 (2020)
[i48]Maciej Besta, Michal Podstawski
, Linus Groner, Edgar Solomonik, Torsten Hoefler:
To Push or To Pull: On Reducing Communication and Synchronization in Graph Computations. CoRR abs/2010.16012 (2020)
[i47]Tal Ben-Nun, Lukas Gianinazzi, Torsten Hoefler, Yishai Oltchik:
Parametric Graph Templates: Properties and Algorithms. CoRR abs/2011.07001 (2020)
[i46]Paul Scheffler, Florian Zaruba, Fabian Schuiki, Torsten Hoefler, Luca Benini:
Indirection Stream Semantic Register Architecture for Efficient Sparse-Dense Linear Algebra. CoRR abs/2011.08070 (2020)
[i45]Chris Cummins, Hugh Leather, Zacharias V. Fisches, Tal Ben-Nun, Torsten Hoefler, Michael F. P. O'Boyle:
Deep Data Flow Analysis. CoRR abs/2012.01470 (2020)
[i44]Marcin Copik
, Grzegorz Kwasniewski, Maciej Besta, Michal Podstawski, Torsten Hoefler:
SeBS: A Serverless Benchmark Suite for Function-as-a-Service Computing. CoRR abs/2012.14132 (2020)
[i43]Marcin Copik
, Alexandru Calotoiu, Tobias Grosser
, Nicolas Wicki, Felix Wolf, Torsten Hoefler:
Extracting Clean Performance Models from Tainted Programs. CoRR abs/2012.15592 (2020)
2010 – 2019
- 2019
[j33]Pedro Yébenes
, Jesús Escudero-Sahuquillo
, Pedro Javier García
, Francisco J. Quiles
, Torsten Hoefler:
Head-of-line blocking avoidance in Slim Fly networks using deadlock-free non-minimal and adaptive routing. Concurr. Comput. Pract. Exp. 31(2) (2019)
[j32]Thomas C. Schulthess, Peter Bauer, Nils Wedi, Oliver Fuhrer, Torsten Hoefler, Christoph M. Schär:
Reflecting on the Goal and Baseline for Exascale Computing: A Roadmap Based on Weather and Climate Simulations. Comput. Sci. Eng. 21(1): 30-41 (2019)
[j31]Tal Ben-Nun
, Torsten Hoefler:
Demystifying Parallel and Distributed Deep Learning: An In-depth Concurrency Analysis. ACM Comput. Surv. 52(4): 65:1-65:43 (2019)
[j30]Claude Barthels
, Ingo Müller, Konstantin Taranov, Gustavo Alonso, Torsten Hoefler:
Strong consistency is not hard to get: Two-Phase Locking and Two-Phase Commit on Thousands of Cores. Proc. VLDB Endow. 12(13): 2325-2338 (2019)
[j29]Sergei Shudler
, Yannick Berens, Alexandru Calotoiu, Torsten Hoefler, Alexandre Strube
, Felix Wolf
:
Engineering Algorithms for Scalability through Continuous Validation of Performance Expectations. IEEE Trans. Parallel Distributed Syst. 30(8): 1768-1785 (2019)
[c166]Tobias Gysi, Tobias Grosser
, Torsten Hoefler:
Absinthe: Learning an Analytical Performance Model to Fuse and Tile Stencil Codes in One Shot. PACT 2019: 370-382
[c165]Niels Gleinig, Frances Ann Hubis, Torsten Hoefler:
Embedding Functions Into Reversible Circuits: A Probabilistic Approach to the Number of Lines. DAC 2019: 72
[c164]Maciej Besta, Marc Fischer, Tal Ben-Nun, Johannes de Fine Licht
, Torsten Hoefler:
Substream-Centric Maximum Matchings on FPGA. FPGA 2019: 152-161
[c163]Paul R. Eller, Torsten Hoefler, William Gropp:
Using performance models to understand scalable Krylov solver performance at scale for structured grid problems. ICS 2019: 138-149
[c162]Tal Ben-Nun, Maciej Besta, Simon Huber, Alexandros Nikolaos Ziogas
, Daniel Peter, Torsten Hoefler:
A Modular Benchmarking Infrastructure for High-Performance and Reproducible Deep Learning. IPDPS 2019: 66-77
[c161]Torsten Hoefler:
Invited Talk 2. IPDPS Workshops 2019: 392
[c160]Salvatore Di Girolamo, Pirmin Schmid
, Thomas C. Schulthess, Torsten Hoefler:
SimFS: A Simulation Data Virtualizing File System Interface. IPDPS 2019: 621-630
[c159]Felix Thaler
, Stefan Moosbrugger, Carlos Osuna, Mauro Bianco, Hannes Vogt, Anton Afanasyev, Lukas Mosimann, Oliver Fuhrer, Thomas C. Schulthess, Torsten Hoefler:
Porting the COSMO Weather Model to Manycore CPUs. PASC 2019: 13:1-13:11
[c158]Tobias Gysi, Tobias Grosser
, Laurin Brandner
, Torsten Hoefler:
A fast analytical model of fully associative caches. PLDI 2019: 816-829
[c157]Martin Küttler, Maksym Planeta, Jan Bierbaum, Carsten Weinhold, Hermann Härtig, Amnon Barak, Torsten Hoefler:
Corrected trees for reliable group communication. PPoPP 2019: 287-299
[c156]Jesper Larsson Träff, Torsten Hoefler:
Foreword EuroMPI 2019. EuroMPI 2019: 1:1-1:2
[c155]Alexandros Nikolaos Ziogas
, Tal Ben-Nun, Guillermo Indalecio Fernández, Timo Schneider, Mathieu Luisier
, Torsten Hoefler:
A data-centric approach to extreme-scale ab initio dissipative quantum transport simulations. SC 2019: 1:1-1:13
[c154]Cédric Renggli, Saleh Ashkboos, Mehdi Aghagolzadeh, Dan Alistarh, Torsten Hoefler:
SparCML: high-performance sparse communication for machine learning. SC 2019: 11:1-11:15
[c153]Daniele De Sensi, Salvatore Di Girolamo, Torsten Hoefler:
Mitigating network noise on Dragonfly networks through application-aware routing. SC 2019: 16:1-16:32
[c152]Grzegorz Kwasniewski, Marko Kabic
, Maciej Besta, Joost VandeVondele, Raffaele Solcà
, Torsten Hoefler:
Red-blue pebbling revisited: near optimal parallel matrix-matrix multiplication. SC 2019: 24:1-24:22
[c151]Maciej Besta, Simon Weber
, Lukas Gianinazzi, Robert Gerstenberger, Andrey Ivanov, Yishai Oltchik, Torsten Hoefler:
Slim graph: practical lossy graph compression for approximate graph processing, storage, and analytics. SC 2019: 35:1-35:25
[c150]Salvatore Di Girolamo, Konstantin Taranov, Andreas Kurth
, Michael Schaffner, Timo Schneider, Jakub Beránek
, Maciej Besta, Luca Benini
, Duncan Roweth, Torsten Hoefler:
Network-accelerated non-contiguous memory transfers. SC 2019: 56:1-56:14
[c149]Alexandros Nikolaos Ziogas
, Tal Ben-Nun, Guillermo Indalecio Fernández, Timo Schneider, Mathieu Luisier, Torsten Hoefler:
Optimizing the data movement in quantum transport simulations via data-centric parallel programming. SC 2019: 78:1-78:17
[c148]Tal Ben-Nun, Johannes de Fine Licht
, Alexandros Nikolaos Ziogas
, Timo Schneider, Torsten Hoefler:
Stateful dataflow multigraphs: a data-centric model for performance portability on heterogeneous architectures. SC 2019: 81:1-81:14
[c147]Tiziano De Matteis
, Johannes de Fine Licht
, Jakub Beránek
, Torsten Hoefler:
Streaming message interface: high-performance distributed memory programming on reconfigurable hardware. SC 2019: 82:1-82:33
[e8]Torsten Hoefler, Jesper Larsson Träff:
Proceedings of the 26th European MPI Users' Group Meeting, EuroMPI 2019, Zürich, Switzerland, September 11-13, 2019. ACM 2019, ISBN 978-1-4503-7175-9 [contents]
[i42]Elad Hoffer, Tal Ben-Nun, Itay Hubara, Niv Giladi, Torsten Hoefler, Daniel Soudry:
Augment your batch: better training with larger batches. CoRR abs/1901.09335 (2019)
[i41]Tal Ben-Nun, Maciej Besta, Simon Huber, Alexandros Nikolaos Ziogas, Daniel Peter, Torsten Hoefler:
A Modular Benchmarking Infrastructure for High-Performance and Reproducible Deep Learning. CoRR abs/1901.10183 (2019)
[i40]Salvatore Di Girolamo, Pirmin Schmid, Thomas C. Schulthess, Torsten Hoefler:
SimFS: A Simulation Data Virtualizing File System Interface. CoRR abs/1902.03154 (2019)
[i39]Tal Ben-Nun, Johannes de Fine Licht, Alexandros Nikolaos Ziogas, Timo Schneider, Torsten Hoefler:
Stateful Dataflow Multigraphs: A Data-Centric Model for High-Performance Parallel Programs. CoRR abs/1902.10345 (2019)
[i38]Maciej Besta, Dimitri Stanojevic, Johannes de Fine Licht, Tal Ben-Nun, Torsten Hoefler:
Graph Processing on FPGAs: Taxonomy, Survey, Challenges. CoRR abs/1903.06697 (2019)
[i37]Maciej Besta, Marcel Schneider, Karolina Cynk, Marek Konieczny, Erik Henriksson, Salvatore Di Girolamo, Ankit Singla, Torsten Hoefler:
FatPaths: Routing in Supercomputers, Data Centers, and Clouds with Low-Diameter Networks when Shortest Paths Fall Short. CoRR abs/1906.10885 (2019)
[i36]Tiziano De Matteis, Johannes de Fine Licht, Torsten Hoefler:
FBLAS: Streaming Linear Algebra on FPGA. CoRR abs/1907.07929 (2019)
[i35]Shigang Li, Tal Ben-Nun, Salvatore Di Girolamo, Dan Alistarh, Torsten Hoefler:
Taming Unbalanced Training Workloads in Deep Learning with Partial Collective Operations. CoRR abs/1908.04207 (2019)
[i34]Salvatore Di Girolamo, Konstantin Taranov, Andreas Kurth, Michael Schaffner, Timo Schneider, Jakub Beránek, Maciej Besta, Luca Benini, Duncan Roweth, Torsten Hoefler:
Network-Accelerated Non-Contiguous Memory Transfers. CoRR abs/1908.08590 (2019)
[i33]Elad Hoffer, Berry Weinstein, Itay Hubara, Tal Ben-Nun, Torsten Hoefler, Daniel Soudry:
Mix & Match: training convnets with mixed image sizes for improved accuracy, speed and scale resiliency. CoRR abs/1908.08986 (2019)
[i32]Grzegorz Kwasniewski, Marko Kabic, Maciej Besta, Joost VandeVondele, Raffaele Solcà, Torsten Hoefler:
Red-blue pebbling revisited: near optimal parallel matrix-matrix multiplication. CoRR abs/1908.09606 (2019)
[i31]Tiziano De Matteis, Johannes de Fine Licht, Jakub Beránek, Torsten Hoefler:
Streaming Message Interface: High-Performance Distributed Memory Programming on Reconfigurable Hardware. CoRR abs/1909.03231 (2019)
[i30]Daniele De Sensi, Salvatore Di Girolamo, Torsten Hoefler:
Mitigating Network Noise on Dragonfly Networks through Application-Aware Routing. CoRR abs/1909.07865 (2019)
[i29]Johannes de Fine Licht, Torsten Hoefler:
hlslib: Software Engineering for Hardware Design. CoRR abs/1910.04436 (2019)
[i28]Maciej Besta, Emanuel Peter, Robert Gerstenberger, Marc Fischer, Michal Podstawski, Claude Barthels, Gustavo Alonso, Torsten Hoefler:
Demystifying Graph Databases: Analysis and Taxonomy of Data Organization, System Designs, and Graph Queries. CoRR abs/1910.09017 (2019)
[i27]Maciej Besta, Torsten Hoefler:
Active Access: A Mechanism for High-Performance Distributed Data-Centric Computations. CoRR abs/1910.12897 (2019)
[i26]Peter Grönquist
, Tal Ben-Nun, Nikoli Dryden, Peter Dueben, Luca Lavarini, Shigang Li, Torsten Hoefler:
Predicting Weather Uncertainty with Deep Convnets. CoRR abs/1911.00630 (2019)
[i25]Maciej Besta, Raghavendra Kanakagiri, Harun Mustafa
, Mikhail Karasikov, Gunnar Rätsch, Torsten Hoefler, Edgar Solomonik:
Communication-Efficient Jaccard Similarity for High-Performance Distributed Genome Comparisons. CoRR abs/1911.04200 (2019)
[i24]Fabian Schuiki, Florian Zaruba, Torsten Hoefler, Luca Benini:
Stream Semantic Registers: A Lightweight RISC-V ISA Extension Achieving Full Compute Utilization in Single-Issue Cores. CoRR abs/1911.08356 (2019)
[i23]Johannes de Fine Licht, Grzegorz Kwasniewski, Torsten Hoefler:
Flexible Communication Avoiding Matrix Multiplication on FPGA with High-Level Synthesis. CoRR abs/1912.06526 (2019)
[i22]Alexandros Nikolaos Ziogas, Tal Ben-Nun, Guillermo Indalecio Fernández, Timo Schneider, Mathieu Luisier, Torsten Hoefler:
Optimizing the Data Movement in Quantum Transport Simulations via Data-Centric Parallel Programming. CoRR abs/1912.08810 (2019)
[i21]Maciej Besta, Simon Weber, Lukas Gianinazzi, Robert Gerstenberger, Andrey Ivanov, Yishai Oltchik, Torsten Hoefler:
Slim Graph: Practical Lossy Graph Compression for Approximate Graph Processing, Storage, and Analytics. CoRR abs/1912.08950 (2019)
[i20]Maciej Besta, Torsten Hoefler:
Slim Fly: A Cost Effective Low-Diameter Network Topology. CoRR abs/1912.08968 (2019)
[i19]Alexandros Nikolaos Ziogas, Tal Ben-Nun, Guillermo Indalecio Fernández, Timo Schneider, Mathieu Luisier, Torsten Hoefler:
A Data-Centric Approach to Extreme-Scale Ab initio Dissipative Quantum Transport Simulations. CoRR abs/1912.10024 (2019)
[i18]Maciej Besta, Marc Fischer, Vasiliki Kalavri, Michael Kapralov, Torsten Hoefler:
Practice of Streaming and Dynamic Graphs: Concepts, Models, Systems, and Parallelism. CoRR abs/1912.12740 (2019)- 2018
[j28]Robert Gerstenberger, Maciej Besta, Torsten Hoefler:
Enabling highly scalable remote memory access programming with MPI-3 one sided. Commun. ACM 61(10): 106-113 (2018)
[j27]Shigang Li
, Yunquan Zhang, Torsten Hoefler:
Cache-Oblivious MPI All-to-All Communications Based on Morton Order. IEEE Trans. Parallel Distributed Syst. 29(3): 542-555 (2018)
[c146]Maciej Besta, Dimitri Stanojevic, Tijana Zivic, Jagpreet Singh, Maurice Hoerold, Torsten Hoefler:
Log(graph): a near-optimal high-performance graph representation. PACT 2018: 7:1-7:13
[c145]Maciej Besta, Syed Minhaj Hassan, Sudhakar Yalamanchili, Rachata Ausavarungnirun, Onur Mutlu
, Torsten Hoefler:
Slim NoC: A Low-Diameter On-Chip Network Topology for High Energy Efficiency and Scalability. ASPLOS 2018: 43-55
[c144]Alexandru Calotoiu, Alexander Graf, Torsten Hoefler, Daniel Lorenz, Sebastian Rinke, Felix Wolf:
Lightweight Requirements Engineering for Exascale Co-design. CLUSTER 2018: 201-211
[c143]Yosuke Oyama, Tal Ben-Nun, Torsten Hoefler, Satoshi Matsuoka:
Accelerating Deep Learning Frameworks with Micro-Batches. CLUSTER 2018: 402-412
[c142]Konstantin Taranov, Gustavo Alonso, Torsten Hoefler:
Fast and strongly-consistent per-item resilience in key-value stores. EuroSys 2018: 39:1-39:14
[c141]Ingo Müller
, Andrea Arteaga, Torsten Hoefler, Gustavo Alonso:
Reproducible Floating-Point Aggregation in RDBMSs. ICDE 2018: 1049-1060
[c140]Tal Ben-Nun, Alice Shoshana Jakobovits, Torsten Hoefler:
Neural Code Comprehension: A Learnable Representation of Code Semantics. NeurIPS 2018: 3589-3601
[c139]Dan Alistarh, Torsten Hoefler, Mikael Johansson, Nikola Konstantinov, Sarit Khirirat, Cédric Renggli:
The Convergence of Sparsified Gradient Methods. NeurIPS 2018: 5977-5987
[c138]Lukas Gianinazzi
, Pavel Kalvoda, Alessandro De Palma, Maciej Besta, Torsten Hoefler:
Communication-avoiding parallel minimum cuts and connected components. PPoPP 2018: 219-232
[c137]Johannes de Fine Licht, Michaela Blott, Torsten Hoefler:
Designing scalable FPGA architectures using high-level synthesis. PPoPP 2018: 403-404
[c136]Heng Lin, Xiaowei Zhu, Bowen Yu, Xiongchao Tang, Wei Xue, Wenguang Chen, Lufei Zhang, Torsten Hoefler, Xiaosong Ma, Xin Liu, Weimin Zheng, Jingfang Xu:
ShenTu: processing multi-trillion edge graphs on millions of cores in seconds. SC 2018: 56:1-56:11
[c135]Cedric Baumann, Andrei Marian Dan, Yuri Meshman, Torsten Hoefler, Martin T. Vechev:
Automatic Verification of RMA Programs via Abstraction Extrapolation. VMCAI 2018: 47-70
[i17]Cédric Renggli, Dan Alistarh, Torsten Hoefler:
SparCML: High-Performance Sparse Communication for Machine Learning. CoRR abs/1802.08021 (2018)
[i16]Ingo Müller, Andrea Arteaga, Torsten Hoefler, Gustavo Alonso:
Reproducible Floating-Point Aggregation in RDBMSs. CoRR abs/1802.09883 (2018)
[i15]Tal Ben-Nun, Torsten Hoefler:
Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis. CoRR abs/1802.09941 (2018)
[i14]Yosuke Oyama, Tal Ben-Nun, Torsten Hoefler, Satoshi Matsuoka:
μ-cuDNN: Accelerating Deep Learning Frameworks with Micro-Batching. CoRR abs/1804.04806 (2018)
[i13]Johannes de Fine Licht, Maciej Besta, Simon Meierhans, Torsten Hoefler:
Transformations of High-Level Synthesis Codes for High-Performance Computing. CoRR abs/1805.08288 (2018)
[i12]Maciej Besta, Torsten Hoefler:
Survey and Taxonomy of Lossless Graph Compression and Space-Efficient Graph Representations. CoRR abs/1806.01799 (2018)
[i11]Tal Ben-Nun, Alice Shoshana Jakobovits, Torsten Hoefler:
Neural Code Comprehension: A Learnable Representation of Code Semantics. CoRR abs/1806.07336 (2018)
[i10]Dan Alistarh, Torsten Hoefler, Mikael Johansson, Sarit Khirirat, Nikola Konstantinov
, Cédric Renggli:
The Convergence of Sparsified Gradient Methods. CoRR abs/1809.10505 (2018)
[i9]Thomas Häner, Torsten Hoefler, Matthias Troyer:
Using Hoare logic for quantum circuit optimization. CoRR abs/1810.00375 (2018)- 2017
[j26]Claude Barthels, Gustavo Alonso, Torsten Hoefler:
Designing Databases for Future High-Performance Networks. IEEE Data Eng. Bull. 40(1): 15-26 (2017)
[j25]Claude Barthels
, Gustavo Alonso, Torsten Hoefler, Timo Schneider, Ingo Müller
:
Distributed Join Algorithms on Thousands of Cores. Proc. VLDB Endow. 10(5): 517-528 (2017)
[j24]Didem Unat
, Anshu Dubey, Torsten Hoefler, John Shalf
, Mark James Abraham
, Mauro Bianco, Bradford L. Chamberlain
, Romain Cledat, H. Carter Edwards, Hal Finkel, Karl Fuerlinger, Frank Hannig
, Emmanuel Jeannot, Amir Kamil
, Jeff Keasler, Paul H. J. Kelly, Vitus J. Leung, Hatem Ltaief
, Naoya Maruyama, Chris J. Newburn, Miquel Pericàs:
Trends in Data Locality Abstractions for HPC Systems. IEEE Trans. Parallel Distributed Syst. 28(10): 3007-3020 (2017)
[c134]Klaus-Tycho Foerster
, Linus Groner, Torsten Hoefler, Michael König, Sascha Schmid, Roger Wattenhofer:
Multi-agent Pathfinding with n Agents on Graphs with n Vertices: Combinatorial Classification and Tight Algorithmic Bounds. CIAC 2017: 247-259
[c133]Pedro Yébenes
, Jesús Escudero-Sahuquillo
, Pedro Javier García
, Francisco J. Quiles
, Torsten Hoefler:
Improving Non-minimal and Adaptive Routing Algorithms in Slim Fly Networks. Hot Interconnects 2017: 1-8
[c132]Timo Schneider, James Dinan, Mario Flajslik, Keith D. Underwood
, Torsten Hoefler:
Fast Networks and Slow Memories: A Mechanism for Mitigating Bandwidth Mismatches. Hot Interconnects 2017: 17-24
[c131]Pedro Yébenes
, Jesús Escudero-Sahuquillo
, Pedro Javier García
, Francisco J. Quiles
, Torsten Hoefler:
An Effective Queuing Scheme to Provide Slim Fly Topologies with HoL Blocking Reduction and Deadlock Freedom for Minimal-Path Routing. HiPINEB@HPCA 2017: 25-32
[c130]Maciej Besta, Michal Podstawski, Linus Groner, Edgar Solomonik, Torsten Hoefler:
To Push or To Pull: On Reducing Communication and Synchronization in Graph Computations. HPDC 2017: 93-104
[c129]Marius Poke, Torsten Hoefler, Colin W. Glass:
AllConcur: Leaderless Concurrent Atomic Broadcast. HPDC 2017: 205-218
[c128]Andrea Arteaga, Oliver Fuhrer, Torsten Hoefler, Thomas C. Schulthess:
Model-Driven Choice of Numerical Methods for the Solution of the Linear Advection Equation. ICCS 2017: 1542-1551
[c127]Maciej Besta, Florian Marending, Edgar Solomonik, Torsten Hoefler:
SlimSell: A Vectorizable Graph Representation for Breadth-First Search. IPDPS 2017: 32-41
[c126]Sabela Ramos, Torsten Hoefler:
Capability Models for Manycore Memory Systems: A Case-Study with Xeon Phi KNL. IPDPS 2017: 297-306
[c125]Torsten Hoefler, Amnon Barak, Amnon Shiloh, Zvi Drezner:
Corrected Gossip Algorithms for Fast Reliable Broadcast on Unreliable Systems. IPDPS 2017: 357-366
[c124]Tobias Wicky, Edgar Solomonik, Torsten Hoefler:
Communication-Avoiding Parallel Algorithms for Solving Triangular Systems of Linear Equations. IPDPS 2017: 678-687
[c123]Salvatore Di Girolamo, Flavio Vella
, Torsten Hoefler:
Transparent Caching for RMA Systems. IPDPS 2017: 1018-1027
[c122]Shuaiwen Leon Song, Torsten Hoefler:
IPDRM Workshop Introduction. IPDPS Workshops 2017: 1284
[c121]Torsten Hoefler:
EMBRACE Keynote. IPDPS Workshops 2017: 1558
[c120]Sergei Shudler
, Alexandru Calotoiu, Torsten Hoefler, Felix Wolf:
Isoefficiency in Practice: Configuring and Understanding the Performance of Task-based Applications. PPoPP 2017: 131-143
[c119]Shigang Li, Yunquan Zhang, Torsten Hoefler:
POSTER: Cache-Oblivious MPI All-to-All Communications on Many-Core Architectures. PPoPP 2017: 445-446
[c118]Edgar Solomonik, Maciej Besta, Flavio Vella
, Torsten Hoefler:
Scaling betweenness centrality using communication-efficient sparse matrix multiplication. SC 2017: 47
[c117]Torsten Hoefler, Salvatore Di Girolamo, Konstantin Taranov, Ryan E. Grant, Ron Brightwell:
sPIN: high-performance streaming processing in the network. SC 2017: 59
[c116]Edgar Solomonik, Grey Ballard
, James Demmel, Torsten Hoefler:
A Communication-Avoiding Parallel Algorithm for the Symmetric Eigenvalue Problem. SPAA 2017: 111-121
[e7]Torsten Hoefler, Kamil Iskra:
Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS@HPDC 2017, Washingon, DC, DC, USA, June 27 - 27, 2017. ACM 2017, ISBN 978-1-4503-5086-0 [contents]
[i8]Edgar Solomonik, James Demmel, Torsten Hoefler:
Communication Lower Bounds of Bilinear Algorithms for Symmetric Tensor Contractions. CoRR abs/1707.04618 (2017)
[i7]Torsten Hoefler, Salvatore Di Girolamo, Konstantin Taranov, Ryan E. Grant, Ron Brightwell:
sPIN: High-performance streaming Processing in the Network. CoRR abs/1709.05483 (2017)- 2016
[j23]Patrick M. Widener
, Scott Levy, Kurt B. Ferreira, Torsten Hoefler:
On noise and the performance benefit of nonblocking collectives. Int. J. High Perform. Comput. Appl. 30(1): 121-133 (2016)
[j22]Salvatore Di Girolamo, Pierre Jolivet, Keith D. Underwood
, Torsten Hoefler:
Exploiting Offload-Enabled Network Interfaces. IEEE Micro 36(4): 6-17 (2016)
[j21]


Google
Google Scholar
Semantic Scholar
Internet Archive Scholar
CiteSeerX
ORCID