Why the Singularity Is Nowhere Near(2015)

This blog post compares deep learning to the brain and derives an estimate of computational power for the brain which is used to predict the singularity. | Continue reading


@timdettmers.com | 2 years ago

Deep Learning Hardware Guide (2018)

In this guide I analyse hardware from CPU to SSD and their impact on performance for deep learning so that you can choose the hardware that you really need. | Continue reading


@timdettmers.com | 3 years ago

Understanding Convolution in Deep Learning

Convolution is probably the most important concept in deep learning right now. It was convolution and convolutional nets that catapulted deep learning to the forefront of almost any machine learning task there is. But what makes convolution so powerful? How does it work? In this … | Continue reading


@timdettmers.com | 3 years ago

My Experience and Advice for Using GPUs in Deep Learning

Continue reading


@timdettmers.com | 3 years ago

How to Pick Your Grad School

How to pick a good advisor? How important is school prestige? How important are peers? I answer these questions and help you find the right grad school. | Continue reading


@timdettmers.com | 4 years ago

On Creativity in Academia

Scientists often lament their lack of creativity when they are actually creative. This blog posts looks closer where their thinking might went wrong. | Continue reading


@timdettmers.com | 4 years ago

Which GPU(s) to Get for Deep Learning

You want a cheap high performance GPU for deep learning? In this blog post I will guide through the choices, so you can find the GPU which is best for you. | Continue reading


@timdettmers.com | 4 years ago

Which GPU(s) to Get for Deep Learning? My Advice for Using GPUs in Deep Learning

You want a cheap high performance GPU for deep learning? In this blog post I will guide through the choices, so you can find the GPU which is best for you. | Continue reading


@timdettmers.com | 5 years ago

A Full Hardware Guide to Deep Learning

In this guide I analyse hardware from CPU to SSD and their impact on performance for deep learning so that you can choose the hardware that you really need. | Continue reading


@timdettmers.com | 5 years ago

Which GPU(s) to Get: My Experience and Advice for Using GPUs in Deep Learning

You want a cheap high performance GPU for deep learning? In this blog post I will guide through the choices, so you can find the GPU which is best for you. | Continue reading


@timdettmers.com | 5 years ago

TPU vs. GPU for matrix multiplications

Here I develop a theoretical model of TPUs vs GPUs for transformers as used by BERT and show that current GPUs are about 32% to 54% slower for this task. | Continue reading


@timdettmers.com | 5 years ago

Which GPU(s) to Get for Deep Learning (Updated with RTX Cards)

You want a cheap high performance GPU for deep learning? In this blog post I will guide through the choices, so you can find the GPU which is best for you. | Continue reading


@timdettmers.com | 5 years ago