| Scalable Bayesian Optimization Using Deep Neural Networks J Snoek, O Rippel, K Swersky, R Kiros, N Satish, N Sundaram, M Patwary, ... arXiv preprint arXiv:1502.05700, 2015 | 1153 | 2015 |
| Megatron-LM: Training Multi-Billion Parameter Language Models Using GPU Model Parallelism M Shoeybi, M Patwary, R Puri, P LeGresley, J Casper, B Catanzaro arXiv preprint arXiv:1909.08053, 2019 | 1041 | 2019 |
| Deep learning scaling is predictable, empirically J Hestness, S Narang, N Ardalani, G Diamos, H Jun, H Kianinejad, ... arXiv preprint arXiv:1712.00409, 2017 | 525 | 2017 |
| Twitter trending topic classification K Lee, D Palsetia, R Narayanan, MMA Patwary, A Agrawal, A Choudhary Data Mining Workshops (ICDMW), 2011 IEEE 11th International Conference on …, 2011 | 451 | 2011 |
| Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model S Smith, M Patwary, B Norick, P LeGresley, S Rajbhandari, J Casper, ... arXiv preprint arXiv:2201.11990, 2022 | 441* | 2022 |
| GraphMat: High performance graph analytics made productive N Sundaram, N Satish, MMA Patwary, SR Dulloor, MJ Anderson, ... Proceedings of the VLDB Endowment 8 (11), 1214-1225, 2015 | 376 | 2015 |
| Efficient large-scale language model training on GPU clusters using megatron-LM D Narayanan, M Shoeybi, J Casper, P LeGresley, M Patwary, ... Proceedings of the International Conference for High Performance Computing …, 2021 | 294 | 2021 |
| Navigating the maze of graph analytics frameworks using massive graph datasets N Satish, N Sundaram, MMA Patwary, J Seo, J Park, MA Hassaan, ... Proceedings of the 2014 ACM SIGMOD international conference on Management of …, 2014 | 243 | 2014 |
| A new scalable parallel DBSCAN algorithm using the disjoint-set data structure MMA Patwary, D Palsetia, A Agrawal, W Liao, F Manne, A Choudhary SC'12: Proceedings of the International Conference on High Performance …, 2012 | 221 | 2012 |
| Training Question Answering Models From Synthetic Data R Puri, R Spring, M Patwary, M Shoeybi, B Catanzaro arXiv preprint arXiv:2002.09599, 2020 | 116 | 2020 |
| Fast maximum clique algorithms for large graphs RA Rossi, DF Gleich, AH Gebremedhin, MMA Patwary Proceedings of the companion publication of the 23rd international …, 2014 | 112 | 2014 |
| Fast Algorithms for the Maximum Clique Problem on Massive Sparse Graphs B Pattabiraman, M Patwary, M Ali, AH Gebremedhin, W Liao, ... arXiv preprint arXiv:1209.5818, 2012 | 107 | 2012 |
| Controllable Story Generation with External Knowledge Using Large-Scale Language Models P Xu, M Patwary, M Shoeybi, R Puri, P Fung, A Anandkumar, B Catanzaro Proceedings of the 2020 Conference on Empirical Methods in Natural Language …, 2020 | 104* | 2020 |
| ColPack: Software for graph coloring and related problems in scientific computing AH Gebremedhin, D Nguyen, MMA Patwary, A Pothen ACM Transactions on Mathematical Software (TOMS) 40 (1), 1-31, 2013 | 98 | 2013 |
| Deep learning at 15PF: supervised and semi-supervised classification for scientific data T Kurth, J Zhang, N Satish, E Racah, I Mitliagkas, MMA Patwary, T Malas, ... Proceedings of the International Conference for High Performance Computing …, 2017 | 93 | 2017 |
| BioMegatron: Larger Biomedical Domain Language Model HC Shin, Y Zhang, E Bakhturina, R Puri, M Patwary, M Shoeybi, R Mani Proceedings of the 2020 Conference on Empirical Methods in Natural Language …, 2020 | 86 | 2020 |
| Parallel efficient sparse matrix-matrix multiplication on multicore platforms MMA Patwary, NR Satish, N Sundaram, J Park, MJ Anderson, ... International Conference on High Performance Computing, 48-57, 2015 | 73 | 2015 |
| End-to-End Training of Neural Retrievers for Open-Domain Question Answering DS Sachan, M Patwary, M Shoeybi, N Kant, W Ping, WL Hamilton, ... arXiv preprint arXiv:2101.00408, 2021 | 70 | 2021 |
| BD-CATS: big data clustering at trillion particle scale MMA Patwary, S Byna, NR Satish, N Sundaram, Z Lukić, V Roytershteyn, ... SC'15: Proceedings of the International Conference for High Performance …, 2015 | 70 | 2015 |
| Graphpad: Optimized graph primitives for parallel and distributed platforms MJ Anderson, N Sundaram, N Satish, MMA Patwary, TL Willke, P Dubey 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS …, 2016 | 68 | 2016 |
Narayanan SundaramFacebookVerified email at fb.com
